![[Jenkins]](/jenkins/static/b68c8964/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-trx" build number 4675 originally caused by: Started by upstream project "master-osmo-trx" build number 4879 originally caused by: Started by upstream project "master-libusrp" build number 1824 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17653 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7504 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6678 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8697 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8943 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2948 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29260 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5150 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30036 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4675 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12965 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9238 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4699 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5189 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5531 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3907 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins4040845810429332875.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-09 15:36:47 + trial_dir_prefix=trial- + rm -rf trial-2360 trial-2360-bin.tgz trial-2360-run.tgz + trial_dir=trial-2361 + mkdir -p trial-2361 + mv open5gs.build-8.tgz osmo-bsc.build-17653.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6678.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2948.tgz osmo-mgw.build-8943.tgz osmo-msc.build-29260.tgz osmo-nitb.build-12965.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30036.tgz osmo-stp.build-9238.tgz osmo-trx.build-4675.tgz osmocom-bb.build-4699.tgz srslte.build-19.tgz trial-2361 + cat open5gs.build-8.md5 osmo-bsc.build-17653.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6678.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2948.md5 osmo-mgw.build-8943.md5 osmo-msc.build-29260.md5 osmo-nitb.build-12965.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30036.md5 osmo-stp.build-9238.md5 osmo-trx.build-4675.md5 osmocom-bb.build-4699.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17653.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6678.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2948.md5 osmo-mgw.build-8943.md5 osmo-msc.build-29260.md5 osmo-nitb.build-12965.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30036.md5 osmo-stp.build-9238.md5 osmo-trx.build-4675.md5 osmocom-bb.build-4699.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2361 combinations: None trial: 'trial-2361' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2361 -------------------------------------------------------------------------------------------- 15:36:58.666206 tst trial-2361: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/log --------------------------------------------------------------------- trial-2361 nitb_sms:sysmo --------------------------------------------------------------------- 15:39:04.702566 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:39:04.707176 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 15:39:04.729427 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 15:39:04.737649 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 15:39:04.791130 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 15:39:04.812073 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 15:39:04.819680 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 15:39:05.358789 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 15:39:05.363836 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 15:39:05.374884 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 15:39:05.752137 tst mo_mt_sms.py: using LAC 22025 15:39:05.993371 tst mo_mt_sms.py: using RAC 95 15:39:06.111279 tst mo_mt_sms.py: using CellId 22025 15:39:06.229630 tst mo_mt_sms.py: using BVCI 22026 15:39:06.332297 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 15:39:06.511839 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 15:39:06.625909 tst mo_mt_sms.py:9: start nitb and bts... 15:39:06.834322 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:39:09.133882 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18285): Launched 15:39:09.443964 run osmo-nitb_10.42.42.2(pid=18286): Launched 15:39:09.612008 run osmo-nitb_10.42.42.2(pid=18286): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18286)] 15:39:09.739622 run osmo-nitb_10.42.42.2(pid=18286): stdout: | (launched: 2022-12-09_15:39:09.386854) 15:39:09.868109 run osmo-nitb_10.42.42.2(pid=18286): stderr: | (launched: 2022-12-09_15:39:09.432893) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:39:09.997111 run osmo-nitb_10.42.42.2(pid=18286): stdout: | (launched: 2022-12-09_15:39:09.386854) 15:39:10.120525 run osmo-nitb_10.42.42.2(pid=18286): stderr: | (launched: 2022-12-09_15:39:09.432893) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:39:10.268705 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=18286): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18286) [trial-2361↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18286)] [trial-2361↪nitb_sms:sysmo↪mo_mt_sms.py:11] 15:39:10.277537 tst mo_mt_sms.py:11: Test FAILED (4.9 sec) 15:39:10.284495 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18285): Terminating (SIGTERM) 15:39:10.495545 --- ParallelTerminationStrategy: PID 18285 died... 15:39:10.516584 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18285): Terminated: ok {rc=0} 15:39:10.603476 bus /sierra_3: Setting Powered False 15:39:11.701406 bus /sierra_3: Setting Powered False 15:39:12.817797 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 sms:sysmo --------------------------------------------------------------------- 15:39:13.996803 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:39:14.001749 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 15:39:14.021935 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 15:39:14.048338 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 15:39:14.102520 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 15:39:14.122780 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 15:39:14.148769 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 15:39:14.694598 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 sms:sysmo mo_mt_sms.py ---------------------------------------------- 15:39:14.699459 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:39:14.709955 tst sms:sysmo: Using 1 x bts (candidates: 1) 15:39:14.743549 tst mo_mt_sms.py: using LAC 22026 15:39:14.856726 tst mo_mt_sms.py: using RAC 96 15:39:14.969366 tst mo_mt_sms.py: using CellId 22026 15:39:15.085516 tst mo_mt_sms.py: using BVCI 22027 15:39:15.190902 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:39:15.201547 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:39:15.212009 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:39:15.222407 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:39:15.232750 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:39:15.243029 tst sms:sysmo: Using 1 x modem (candidates: 2) 15:39:15.358792 tst sms:sysmo: Using 1 x modem (candidates: 2) 15:39:15.479167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:39:17.233760 run create_hlr_db(pid=18292): Launched 15:39:17.356168 bus /sierra_2: Setting Powered False 15:39:18.418563 run create_hlr_db(pid=18292): Terminated: ok {rc=0} 15:39:18.837638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18294): Launched 15:39:19.127842 run osmo-hlr_10.42.42.2(pid=18295): Launched 15:39:19.237984 run osmo-stp_10.42.42.5: Starting osmo-stp 15:39:21.646815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18297): Launched 15:39:21.937373 run osmo-stp_10.42.42.5(pid=18298): Launched 15:39:22.047069 run osmo-msc_10.42.42.6: Starting osmo-msc 15:39:27.218285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18300): Launched 15:39:27.506494 run osmo-msc_10.42.42.6(pid=18301): Launched 15:39:27.665726 run osmo-stp_10.42.42.5(pid=18298): ERR: Terminated: ERROR {rc=1} [trial-2361↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18298)] 15:39:27.787434 run osmo-stp_10.42.42.5(pid=18298): stdout: | (launched: 2022-12-09_15:39:21.883294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:27.910890 run osmo-stp_10.42.42.5(pid=18298): stderr: | [0;m[38;5;43m20221209153922053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209153922053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209153922053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209153922054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209153922056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209153922056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209153922056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:28.031229 run osmo-stp_10.42.42.5(pid=18298): stdout: | (launched: 2022-12-09_15:39:21.883294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:28.146563 run osmo-stp_10.42.42.5(pid=18298): stderr: | [0;m[38;5;43m20221209153922053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209153922053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209153922053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209153922054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209153922056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209153922056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209153922056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:28.284379 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=18298): Process ended prematurely: osmo-stp_10.42.42.5(pid=18298) [trial-2361↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18298)] [trial-2361↪sms:sysmo↪mo_mt_sms.py:16] 15:39:28.292403 tst mo_mt_sms.py:16: Test FAILED (13.6 sec) 15:39:28.318243 run osmo-hlr_10.42.42.2(pid=18295): ERR: Terminated: ERROR {rc=237} [trial-2361↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18295)] 15:39:28.365911 run osmo-hlr_10.42.42.2(pid=18295): stdout: | (launched: 2022-12-09_15:39:19.073730) 15:39:28.415113 run osmo-hlr_10.42.42.2(pid=18295): stderr: | [0;m[1;31m20221209153919251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209153919251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209153919252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209153919252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209153919252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209153919252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209153919264 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209153919273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209153919273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209153919273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:39:28.483504 run osmo-msc_10.42.42.6(pid=18301): ERR: Terminated: ERROR {rc=2} [trial-2361↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18301)] 15:39:28.530899 run osmo-msc_10.42.42.6(pid=18301): stdout: | (launched: 2022-12-09_15:39:27.452536) 15:39:28.579886 run osmo-msc_10.42.42.6(pid=18301): stderr: | [0;m[38;5;43m20221209153927726 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209153927726 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff040086c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209153927726 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209153927726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209153927726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209153927727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209153927730 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209153927730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209153927731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209153927731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:39:28.629333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18294): Terminating (SIGTERM) 15:39:28.668907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18297): Terminating (SIGTERM) 15:39:28.708636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18300): Terminating (SIGTERM) 15:39:28.748301 --- ParallelTerminationStrategy: PID 18294 died... 15:39:28.767198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18294): Terminated: ok {rc=0} 15:39:28.811396 --- ParallelTerminationStrategy: PID 18297 died... 15:39:28.829856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18297): Terminated: ok {rc=0} 15:39:28.873704 --- ParallelTerminationStrategy: PID 18300 died... 15:39:28.891929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18300): Terminated: ok {rc=0} 15:39:28.977518 bus /sierra_3: Setting Powered False 15:39:30.082056 bus /sierra_3: Setting Powered False 15:39:31.195998 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_ussd:sysmo --------------------------------------------------------------------- 15:39:32.446055 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:39:32.450104 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 15:39:32.471742 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 15:39:32.478827 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 15:39:32.517430 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 15:39:32.539307 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 15:39:32.546648 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 15:39:33.062192 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2361 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 15:39:33.067945 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 15:39:33.078832 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 15:39:33.113550 tst assert_extension.py: using LAC 22027 15:39:33.230589 tst assert_extension.py: using RAC 97 15:39:33.344022 tst assert_extension.py: using CellId 22027 15:39:33.457670 tst assert_extension.py: using BVCI 22028 15:39:33.561841 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 15:39:33.679631 tst assert_extension.py:10: start nitb and bts... 15:39:33.874030 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:39:34.464693 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18310): Launched 15:39:34.754166 run osmo-nitb_10.42.42.2(pid=18311): Launched 15:39:34.913097 run osmo-nitb_10.42.42.2(pid=18311): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18311)] 15:39:35.042509 run osmo-nitb_10.42.42.2(pid=18311): stdout: | (launched: 2022-12-09_15:39:34.700360) 15:39:35.194693 run osmo-nitb_10.42.42.2(pid=18311): stderr: | (launched: 2022-12-09_15:39:34.743159) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:39:35.358602 run osmo-nitb_10.42.42.2(pid=18311): stdout: | (launched: 2022-12-09_15:39:34.700360) 15:39:35.512458 run osmo-nitb_10.42.42.2(pid=18311): stderr: | (launched: 2022-12-09_15:39:34.743159) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18311): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18311) [trial-2361↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18311)] 15:39:35.862840 tst osmo-nitb_10.42.42.2(pid=18311): stdout: | (launched: 2022-12-09_15:39:34.700360) 15:39:35.979920 tst osmo-nitb_10.42.42.2(pid=18311): stderr: | (launched: 2022-12-09_15:39:34.743159) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:39:36.117113 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=18311): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18311) [trial-2361↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18311)] [trial-2361↪nitb_ussd:sysmo↪assert_extension.py:12] 15:39:36.125319 tst assert_extension.py:12: Test FAILED (3.1 sec) 15:39:36.131754 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18310): Terminating (SIGTERM) 15:39:36.340218 --- ParallelTerminationStrategy: PID 18310 died... 15:39:36.360322 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18310): Terminated: ok {rc=0} 15:39:36.442870 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 ussd:sysmo --------------------------------------------------------------------- 15:39:37.624555 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:39:37.629240 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 15:39:37.649881 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 15:39:37.676056 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 15:39:37.709711 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 15:39:37.730013 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 15:39:37.756473 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 15:39:38.287152 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2361 ussd:sysmo assert_extension.py ---------------------------------------------- 15:39:38.292687 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:39:38.303701 tst ussd:sysmo: Using 1 x bts (candidates: 1) 15:39:38.338387 tst assert_extension.py: using LAC 22028 15:39:38.459483 tst assert_extension.py: using RAC 98 15:39:38.580476 tst assert_extension.py: using CellId 22028 15:39:38.701137 tst assert_extension.py: using BVCI 22029 15:39:38.813684 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:39:38.824481 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:39:38.835323 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:39:38.846534 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:39:38.857641 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:39:38.868650 tst ussd:sysmo: Using 1 x modem (candidates: 1) 15:39:38.981832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:39:39.431896 run create_hlr_db(pid=18315): Launched 15:39:39.551302 bus /sierra_2: Setting Powered False 15:39:40.608892 run create_hlr_db(pid=18315): Terminated: ok {rc=0} 15:39:41.036352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18317): Launched 15:39:41.349151 run osmo-hlr_10.42.42.2(pid=18318): Launched 15:39:41.468548 run osmo-stp_10.42.42.5: Starting osmo-stp 15:39:42.013308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18320): Launched 15:39:42.325839 run osmo-stp_10.42.42.5(pid=18321): Launched 15:39:42.445034 run osmo-msc_10.42.42.6: Starting osmo-msc 15:39:43.008418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18323): Launched 15:39:43.321604 run osmo-msc_10.42.42.6(pid=18324): Launched 15:39:43.494948 run osmo-stp_10.42.42.5(pid=18321): ERR: Terminated: ERROR {rc=1} [trial-2361↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18321)] 15:39:43.627750 run osmo-stp_10.42.42.5(pid=18321): stdout: | (launched: 2022-12-09_15:39:42.267792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:43.760353 run osmo-stp_10.42.42.5(pid=18321): stderr: | [0;m[38;5;43m20221209153942459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209153942459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209153942459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209153942460 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209153942460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209153942460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209153942460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:43.892435 run osmo-stp_10.42.42.5(pid=18321): stdout: | (launched: 2022-12-09_15:39:42.267792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:44.017407 run osmo-stp_10.42.42.5(pid=18321): stderr: | [0;m[38;5;43m20221209153942459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209153942459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209153942459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209153942460 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209153942460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209153942460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209153942460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:44.166396 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=18321): Process ended prematurely: osmo-stp_10.42.42.5(pid=18321) [trial-2361↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18321)] [trial-2361↪ussd:sysmo↪assert_extension.py:17] 15:39:44.175074 tst assert_extension.py:17: Test FAILED (5.9 sec) 15:39:44.202310 run osmo-hlr_10.42.42.2(pid=18318): ERR: Terminated: ERROR {rc=237} [trial-2361↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18318)] 15:39:44.253089 run osmo-hlr_10.42.42.2(pid=18318): stdout: | (launched: 2022-12-09_15:39:41.291078) 15:39:44.304692 run osmo-hlr_10.42.42.2(pid=18318): stderr: | [0;m[1;31m20221209153941488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209153941488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209153941488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209153941488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209153941488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209153941488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209153941504 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209153941514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209153941514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209153941514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:39:44.376577 run osmo-msc_10.42.42.6(pid=18324): ERR: Terminated: ERROR {rc=2} [trial-2361↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18324)] 15:39:44.426587 run osmo-msc_10.42.42.6(pid=18324): stdout: | (launched: 2022-12-09_15:39:43.263543) 15:39:44.478221 run osmo-msc_10.42.42.6(pid=18324): stderr: | [0;m[38;5;43m20221209153943587 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209153943588 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6342a6dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209153943588 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209153943588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209153943588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209153943588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209153943590 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209153943590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209153943590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209153943591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:39:44.530498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18317): Terminating (SIGTERM) 15:39:44.572671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18320): Terminating (SIGTERM) 15:39:44.614724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18323): Terminating (SIGTERM) 15:39:44.656839 --- ParallelTerminationStrategy: PID 18317 died... 15:39:44.676717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18317): Terminated: ok {rc=0} 15:39:44.723123 --- ParallelTerminationStrategy: PID 18320 died... 15:39:44.742542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18320): Terminated: ok {rc=0} 15:39:44.788732 --- ParallelTerminationStrategy: PID 18323 died... 15:39:44.808033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18323): Terminated: ok {rc=0} 15:39:44.895455 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 15:39:46.095827 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:39:46.103643 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 15:39:46.127894 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 15:39:46.157206 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 15:39:46.215591 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 15:39:46.255061 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 15:39:46.291881 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 15:39:46.815637 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 15:39:46.884910 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:39:46.899582 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:39:46.963352 tst mo_mt_call.py: using LAC 22029 15:39:47.119186 tst mo_mt_call.py: using RAC 99 15:39:47.237713 tst mo_mt_call.py: using CellId 22029 15:39:47.367683 tst mo_mt_call.py: using BVCI 22030 15:39:47.483169 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:39:47.494919 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:39:47.506409 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:39:47.518621 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:39:47.530793 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:39:47.542846 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:39:47.661727 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:39:47.775986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:39:48.233526 run create_hlr_db(pid=18329): Launched 15:39:48.354528 bus /sierra_2: Setting Powered False 15:39:49.413482 run create_hlr_db(pid=18329): Terminated: ok {rc=0} 15:39:49.848374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18331): Launched 15:39:50.166582 run osmo-hlr_10.42.42.2(pid=18332): Launched 15:39:50.288067 run osmo-stp_10.42.42.5: Starting osmo-stp 15:39:50.840233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18334): Launched 15:39:51.158237 run osmo-stp_10.42.42.5(pid=18335): Launched 15:39:51.279314 run osmo-msc_10.42.42.6: Starting osmo-msc 15:39:51.851579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18337): Launched 15:39:52.168437 run osmo-msc_10.42.42.6(pid=18338): Launched 15:39:52.345775 run osmo-stp_10.42.42.5(pid=18335): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18335)] 15:39:52.479792 run osmo-stp_10.42.42.5(pid=18335): stdout: | (launched: 2022-12-09_15:39:51.099495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:52.614199 run osmo-stp_10.42.42.5(pid=18335): stderr: | [0;m[38;5;43m20221209153951293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209153951293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209153951293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209153951294 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209153951294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209153951294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209153951294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:52.748318 run osmo-stp_10.42.42.5(pid=18335): stdout: | (launched: 2022-12-09_15:39:51.099495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:52.874119 run osmo-stp_10.42.42.5(pid=18335): stderr: | [0;m[38;5;43m20221209153951293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209153951293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209153951293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209153951294 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209153951294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209153951294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209153951294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:53.024888 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18335): Process ended prematurely: osmo-stp_10.42.42.5(pid=18335) [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18335)] [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 15:39:53.034311 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:39:53.062032 run osmo-hlr_10.42.42.2(pid=18332): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18332)] 15:39:53.111884 run osmo-hlr_10.42.42.2(pid=18332): stdout: | (launched: 2022-12-09_15:39:50.108032) 15:39:53.163466 run osmo-hlr_10.42.42.2(pid=18332): stderr: | [0;m[1;31m20221209153950307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209153950307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209153950307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209153950307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209153950307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209153950307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209153950320 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209153950329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209153950330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209153950330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:39:53.234905 run osmo-msc_10.42.42.6(pid=18338): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18338)] 15:39:53.284612 run osmo-msc_10.42.42.6(pid=18338): stdout: | (launched: 2022-12-09_15:39:52.109949) 15:39:53.335803 run osmo-msc_10.42.42.6(pid=18338): stderr: | [0;m[38;5;43m20221209153952431 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209153952432 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1601b4dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209153952432 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209153952432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209153952432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209153952432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209153952434 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209153952434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209153952434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209153952435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:39:53.387352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18331): Terminating (SIGTERM) 15:39:53.428834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18334): Terminating (SIGTERM) 15:39:53.470465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18337): Terminating (SIGTERM) 15:39:53.512315 --- ParallelTerminationStrategy: PID 18331 died... 15:39:53.532080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18331): Terminated: ok {rc=0} 15:39:53.578513 --- ParallelTerminationStrategy: PID 18334 died... 15:39:53.597967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18334): Terminated: ok {rc=0} 15:39:53.643865 --- ParallelTerminationStrategy: PID 18337 died... 15:39:53.663154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18337): Terminated: ok {rc=0} 15:39:53.749095 bus /sierra_3: Setting Powered False 15:39:54.845759 bus /sierra_3: Setting Powered False 15:39:55.959825 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 15:39:57.103251 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:39:57.114816 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:39:57.170280 tst mo_mt_call_osmux.py: using LAC 22030 15:39:57.285803 tst mo_mt_call_osmux.py: using RAC 100 15:39:57.402692 tst mo_mt_call_osmux.py: using CellId 22030 15:39:57.519283 tst mo_mt_call_osmux.py: using BVCI 22031 15:39:57.625066 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:39:57.635896 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:39:57.646696 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:39:57.657481 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:39:57.668344 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:39:57.679191 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:39:57.795568 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:39:57.909567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:39:58.365838 run create_hlr_db(pid=18340): Launched 15:39:58.485321 bus /sierra_2: Setting Powered False 15:39:59.544550 run create_hlr_db(pid=18340): Terminated: ok {rc=0} 15:39:59.979339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18342): Launched 15:40:00.300169 run osmo-hlr_10.42.42.2(pid=18343): Launched 15:40:00.422228 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:01.016807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18345): Launched 15:40:01.349399 run osmo-stp_10.42.42.5(pid=18346): Launched 15:40:01.518850 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:02.209805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18351): Launched 15:40:02.537039 run osmo-msc_10.42.42.6(pid=18352): Launched 15:40:02.715327 run osmo-stp_10.42.42.5(pid=18346): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18346)] 15:40:02.849734 run osmo-stp_10.42.42.5(pid=18346): stdout: | (launched: 2022-12-09_15:40:01.284831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:02.984389 run osmo-stp_10.42.42.5(pid=18346): stderr: | [0;m[38;5;43m20221209154001612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154001612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154001612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154001613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154001615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154001615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154001615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:03.118896 run osmo-stp_10.42.42.5(pid=18346): stdout: | (launched: 2022-12-09_15:40:01.284831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:03.245322 run osmo-stp_10.42.42.5(pid=18346): stderr: | [0;m[38;5;43m20221209154001612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154001612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154001612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154001613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154001615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154001615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154001615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:03.396879 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18346): Process ended prematurely: osmo-stp_10.42.42.5(pid=18346) [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18346)] [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 15:40:03.406360 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:40:03.434005 run osmo-hlr_10.42.42.2(pid=18343): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18343)] 15:40:03.484404 run osmo-hlr_10.42.42.2(pid=18343): stdout: | (launched: 2022-12-09_15:40:00.241246) 15:40:03.536086 run osmo-hlr_10.42.42.2(pid=18343): stderr: | [0;m[1;31m20221209154000440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154000440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154000440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154000440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154000440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154000440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154000451 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154000460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154000460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154000460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:03.607953 run osmo-msc_10.42.42.6(pid=18352): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18352)] 15:40:03.657983 run osmo-msc_10.42.42.6(pid=18352): stdout: | (launched: 2022-12-09_15:40:02.478325) 15:40:03.709718 run osmo-msc_10.42.42.6(pid=18352): stderr: | [0;m[38;5;43m20221209154002804 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154002804 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f91a9593c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154002804 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154002804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154002805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154002805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154002806 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154002807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154002807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154002807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:03.761564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18342): Terminating (SIGTERM) 15:40:03.803215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18345): Terminating (SIGTERM) 15:40:03.844873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18351): Terminating (SIGTERM) 15:40:03.887022 --- ParallelTerminationStrategy: PID 18342 died... 15:40:03.906994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18342): Terminated: ok {rc=0} 15:40:03.953494 --- ParallelTerminationStrategy: PID 18345 died... 15:40:03.973236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18345): Terminated: ok {rc=0} 15:40:04.019493 --- ParallelTerminationStrategy: PID 18351 died... 15:40:04.038930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18351): Terminated: ok {rc=0} 15:40:04.126575 bus /sierra_3: Setting Powered False 15:40:05.225240 bus /sierra_3: Setting Powered False 15:40:06.343228 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 15:40:07.578695 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:07.585762 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 15:40:07.607597 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 15:40:07.634992 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 15:40:07.687189 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 15:40:07.708134 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 15:40:07.735361 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 15:40:08.292015 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 15:40:08.343178 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:08.354712 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:40:08.410843 tst mo_mt_call.py: using LAC 22031 15:40:08.536038 tst mo_mt_call.py: using RAC 101 15:40:08.660525 tst mo_mt_call.py: using CellId 22031 15:40:08.784036 tst mo_mt_call.py: using BVCI 22032 15:40:08.899242 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:08.910737 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:08.922044 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:08.933537 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:08.945056 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:08.956418 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:40:09.074189 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:40:09.193297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:09.686129 run create_hlr_db(pid=18357): Launched 15:40:09.806910 bus /sierra_2: Setting Powered False 15:40:10.869243 run create_hlr_db(pid=18357): Terminated: ok {rc=0} 15:40:11.293630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18359): Launched 15:40:11.590489 run osmo-hlr_10.42.42.2(pid=18360): Launched 15:40:11.704240 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:12.230683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18362): Launched 15:40:12.527436 run osmo-stp_10.42.42.5(pid=18363): Launched 15:40:12.638462 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:13.185921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18365): Launched 15:40:13.480204 run osmo-msc_10.42.42.6(pid=18366): Launched 15:40:13.643689 run osmo-stp_10.42.42.5(pid=18363): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18363)] 15:40:13.769433 run osmo-stp_10.42.42.5(pid=18363): stdout: | (launched: 2022-12-09_15:40:12.471988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:13.894010 run osmo-stp_10.42.42.5(pid=18363): stderr: | [0;m[38;5;43m20221209154012646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154012646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154012646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154012647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154012647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154012647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154012647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:14.016365 run osmo-stp_10.42.42.5(pid=18363): stdout: | (launched: 2022-12-09_15:40:12.471988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:14.133144 run osmo-stp_10.42.42.5(pid=18363): stderr: | [0;m[38;5;43m20221209154012646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154012646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154012646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154012647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154012647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154012647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154012647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:14.272829 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18363): Process ended prematurely: osmo-stp_10.42.42.5(pid=18363) [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18363)] [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 15:40:14.281477 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 15:40:14.307002 run osmo-hlr_10.42.42.2(pid=18360): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18360)] 15:40:14.353836 run osmo-hlr_10.42.42.2(pid=18360): stdout: | (launched: 2022-12-09_15:40:11.534942) 15:40:14.402060 run osmo-hlr_10.42.42.2(pid=18360): stderr: | [0;m[1;31m20221209154011712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154011712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154011712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154011712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154011712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154011712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154011725 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154011734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154011734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154011734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:14.469267 run osmo-msc_10.42.42.6(pid=18366): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18366)] 15:40:14.516069 run osmo-msc_10.42.42.6(pid=18366): stdout: | (launched: 2022-12-09_15:40:13.425281) 15:40:14.564261 run osmo-msc_10.42.42.6(pid=18366): stderr: | [0;m[38;5;43m20221209154013699 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154013700 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7effd860ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154013700 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154013700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154013700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154013700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154013702 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154013702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154013702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154013703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:14.612539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18359): Terminating (SIGTERM) 15:40:14.651064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18362): Terminating (SIGTERM) 15:40:14.689262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18365): Terminating (SIGTERM) 15:40:14.728147 --- ParallelTerminationStrategy: PID 18359 died... 15:40:14.746526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18359): Terminated: ok {rc=0} 15:40:14.789378 --- ParallelTerminationStrategy: PID 18362 died... 15:40:14.807807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18362): Terminated: ok {rc=0} 15:40:14.850695 --- ParallelTerminationStrategy: PID 18365 died... 15:40:14.868704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18365): Terminated: ok {rc=0} 15:40:14.950050 bus /sierra_3: Setting Powered False 15:40:16.046016 bus /sierra_3: Setting Powered False 15:40:17.174974 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 15:40:18.313461 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:18.324882 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:40:18.381022 tst mo_mt_call_osmux.py: using LAC 22032 15:40:18.497028 tst mo_mt_call_osmux.py: using RAC 102 15:40:18.611888 tst mo_mt_call_osmux.py: using CellId 22032 15:40:18.737540 tst mo_mt_call_osmux.py: using BVCI 22033 15:40:18.853487 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:18.865129 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:18.876419 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:18.888008 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:18.899589 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:40:18.911136 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:40:19.029549 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:40:19.145651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:19.602768 run create_hlr_db(pid=18368): Launched 15:40:19.723845 bus /sierra_2: Setting Powered False 15:40:20.783528 run create_hlr_db(pid=18368): Terminated: ok {rc=0} 15:40:21.219936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18370): Launched 15:40:21.540560 run osmo-hlr_10.42.42.2(pid=18371): Launched 15:40:21.663126 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:22.213194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18373): Launched 15:40:22.531519 run osmo-stp_10.42.42.5(pid=18374): Launched 15:40:22.652570 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:23.230699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18376): Launched 15:40:23.550174 run osmo-msc_10.42.42.6(pid=18377): Launched 15:40:23.729996 run osmo-stp_10.42.42.5(pid=18374): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18374)] 15:40:23.864578 run osmo-stp_10.42.42.5(pid=18374): stdout: | (launched: 2022-12-09_15:40:22.473063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:23.999972 run osmo-stp_10.42.42.5(pid=18374): stderr: | [0;m[38;5;43m20221209154022665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154022666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154022666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154022666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154022667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154022667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154022667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:24.134998 run osmo-stp_10.42.42.5(pid=18374): stdout: | (launched: 2022-12-09_15:40:22.473063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:24.261196 run osmo-stp_10.42.42.5(pid=18374): stderr: | [0;m[38;5;43m20221209154022665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154022666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154022666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154022666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154022667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154022667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154022667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:24.413349 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18374): Process ended prematurely: osmo-stp_10.42.42.5(pid=18374) [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18374)] [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 15:40:24.422654 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 15:40:24.450416 run osmo-hlr_10.42.42.2(pid=18371): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18371)] 15:40:24.499819 run osmo-hlr_10.42.42.2(pid=18371): stdout: | (launched: 2022-12-09_15:40:21.481939) 15:40:24.551051 run osmo-hlr_10.42.42.2(pid=18371): stderr: | [0;m[1;31m20221209154021681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154021681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154021681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154021682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154021682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154021682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154021693 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154021701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154021701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154021701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:24.622432 run osmo-msc_10.42.42.6(pid=18377): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18377)] 15:40:24.672205 run osmo-msc_10.42.42.6(pid=18377): stdout: | (launched: 2022-12-09_15:40:23.491272) 15:40:24.723425 run osmo-msc_10.42.42.6(pid=18377): stderr: | [0;m[38;5;43m20221209154023813 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154023813 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f21ec0b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154023813 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154023813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154023813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154023814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154023815 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154023816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154023816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154023816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:24.774821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18370): Terminating (SIGTERM) 15:40:24.815908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18373): Terminating (SIGTERM) 15:40:24.857458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18376): Terminating (SIGTERM) 15:40:24.899253 --- ParallelTerminationStrategy: PID 18370 died... 15:40:24.918905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18370): Terminated: ok {rc=0} 15:40:24.964888 --- ParallelTerminationStrategy: PID 18373 died... 15:40:24.984176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18373): Terminated: ok {rc=0} 15:40:25.030013 --- ParallelTerminationStrategy: PID 18376 died... 15:40:25.049228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18376): Terminated: ok {rc=0} 15:40:25.135461 bus /sierra_3: Setting Powered False 15:40:26.232520 bus /sierra_3: Setting Powered False 15:40:27.347442 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 15:40:28.586646 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:28.593828 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 15:40:28.616379 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 15:40:28.644404 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 15:40:28.695593 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 15:40:28.716130 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 15:40:28.742462 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 15:40:29.293339 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 15:40:29.340688 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:29.352020 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:40:29.406910 tst mo_mt_call.py: using LAC 22033 15:40:29.522731 tst mo_mt_call.py: using RAC 103 15:40:29.636611 tst mo_mt_call.py: using CellId 22033 15:40:29.751391 tst mo_mt_call.py: using BVCI 22034 15:40:29.857841 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:29.868927 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:29.879737 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:29.890739 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:29.901828 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:29.912821 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:40:30.030951 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:40:30.149465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:30.643847 run create_hlr_db(pid=18382): Launched 15:40:30.765977 bus /sierra_2: Setting Powered False 15:40:31.830031 run create_hlr_db(pid=18382): Terminated: ok {rc=0} 15:40:32.293114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18384): Launched 15:40:32.611927 run osmo-hlr_10.42.42.2(pid=18385): Launched 15:40:32.732599 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:33.282417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18387): Launched 15:40:33.600548 run osmo-stp_10.42.42.5(pid=18388): Launched 15:40:33.721546 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:34.296229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18390): Launched 15:40:34.615711 run osmo-msc_10.42.42.6(pid=18391): Launched 15:40:34.792596 run osmo-stp_10.42.42.5(pid=18388): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18388)] 15:40:34.927204 run osmo-stp_10.42.42.5(pid=18388): stdout: | (launched: 2022-12-09_15:40:33.541892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:35.062265 run osmo-stp_10.42.42.5(pid=18388): stderr: | [0;m[38;5;43m20221209154033735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154033735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154033735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154033735 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154033736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154033736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154033736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:35.196605 run osmo-stp_10.42.42.5(pid=18388): stdout: | (launched: 2022-12-09_15:40:33.541892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:35.323824 run osmo-stp_10.42.42.5(pid=18388): stderr: | [0;m[38;5;43m20221209154033735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154033735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154033735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154033735 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154033736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154033736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154033736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:35.475615 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18388): Process ended prematurely: osmo-stp_10.42.42.5(pid=18388) [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18388)] [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 15:40:35.484759 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:40:35.512322 run osmo-hlr_10.42.42.2(pid=18385): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18385)] 15:40:35.562334 run osmo-hlr_10.42.42.2(pid=18385): stdout: | (launched: 2022-12-09_15:40:32.553692) 15:40:35.613671 run osmo-hlr_10.42.42.2(pid=18385): stderr: | [0;m[1;31m20221209154032751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154032751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154032751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154032751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154032751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154032751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154032765 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154032773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154032774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154032774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:35.684922 run osmo-msc_10.42.42.6(pid=18391): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18391)] 15:40:35.734758 run osmo-msc_10.42.42.6(pid=18391): stdout: | (launched: 2022-12-09_15:40:34.556834) 15:40:35.786153 run osmo-msc_10.42.42.6(pid=18391): stderr: | [0;m[38;5;43m20221209154034879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154034879 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbde7c32c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154034879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154034879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154034879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154034879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154034881 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154034881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154034882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154034882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:35.838033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18384): Terminating (SIGTERM) 15:40:35.879536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18387): Terminating (SIGTERM) 15:40:35.921092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18390): Terminating (SIGTERM) 15:40:35.962828 --- ParallelTerminationStrategy: PID 18384 died... 15:40:35.982499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18384): Terminated: ok {rc=0} 15:40:36.028731 --- ParallelTerminationStrategy: PID 18387 died... 15:40:36.048003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18387): Terminated: ok {rc=0} 15:40:36.094148 --- ParallelTerminationStrategy: PID 18390 died... 15:40:36.113470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18390): Terminated: ok {rc=0} 15:40:36.200429 bus /sierra_3: Setting Powered False 15:40:37.299266 bus /sierra_3: Setting Powered False 15:40:38.414237 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 15:40:39.555287 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:39.566967 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:40:39.622484 tst mo_mt_call_osmux.py: using LAC 22034 15:40:39.738435 tst mo_mt_call_osmux.py: using RAC 104 15:40:39.855698 tst mo_mt_call_osmux.py: using CellId 22034 15:40:39.971968 tst mo_mt_call_osmux.py: using BVCI 22035 15:40:40.080332 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:40.091511 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:40.102582 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:40.113646 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:40.124529 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:40:40.135513 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:40:40.249847 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:40:40.364189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:40.822725 run create_hlr_db(pid=18393): Launched 15:40:40.942848 bus /sierra_2: Setting Powered False 15:40:42.002016 run create_hlr_db(pid=18393): Terminated: ok {rc=0} 15:40:42.439257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18395): Launched 15:40:42.758948 run osmo-hlr_10.42.42.2(pid=18396): Launched 15:40:42.879925 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:43.432604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18398): Launched 15:40:43.751244 run osmo-stp_10.42.42.5(pid=18399): Launched 15:40:43.872684 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:44.449352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18401): Launched 15:40:44.770108 run osmo-msc_10.42.42.6(pid=18402): Launched 15:40:44.947598 run osmo-stp_10.42.42.5(pid=18399): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18399)] 15:40:45.081796 run osmo-stp_10.42.42.5(pid=18399): stdout: | (launched: 2022-12-09_15:40:43.692532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:45.216886 run osmo-stp_10.42.42.5(pid=18399): stderr: | [0;m[38;5;43m20221209154043884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154043884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154043884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154043885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154043887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154043887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154043887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:45.351740 run osmo-stp_10.42.42.5(pid=18399): stdout: | (launched: 2022-12-09_15:40:43.692532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:45.478444 run osmo-stp_10.42.42.5(pid=18399): stderr: | [0;m[38;5;43m20221209154043884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154043884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154043884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154043885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154043887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154043887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154043887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:45.630082 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18399): Process ended prematurely: osmo-stp_10.42.42.5(pid=18399) [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18399)] [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 15:40:45.639613 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 15:40:45.667780 run osmo-hlr_10.42.42.2(pid=18396): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18396)] 15:40:45.717777 run osmo-hlr_10.42.42.2(pid=18396): stdout: | (launched: 2022-12-09_15:40:42.700338) 15:40:45.769536 run osmo-hlr_10.42.42.2(pid=18396): stderr: | [0;m[1;31m20221209154042897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154042897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154042897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154042897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154042897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154042897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154042909 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154042919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154042919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154042920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:45.842431 run osmo-msc_10.42.42.6(pid=18402): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18402)] 15:40:45.896492 run osmo-msc_10.42.42.6(pid=18402): stdout: | (launched: 2022-12-09_15:40:44.710688) 15:40:45.961489 run osmo-msc_10.42.42.6(pid=18402): stderr: | [0;m[38;5;43m20221209154045033 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154045033 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f58f5738c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154045034 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154045034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154045034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154045034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154045036 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154045036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154045036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154045036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:46.015099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18395): Terminating (SIGTERM) 15:40:46.059190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18398): Terminating (SIGTERM) 15:40:46.102746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18401): Terminating (SIGTERM) 15:40:46.145756 --- ParallelTerminationStrategy: PID 18395 died... 15:40:46.165537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18395): Terminated: ok {rc=0} 15:40:46.212851 --- ParallelTerminationStrategy: PID 18398 died... 15:40:46.232501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18398): Terminated: ok {rc=0} 15:40:46.277643 --- ParallelTerminationStrategy: PID 18401 died... 15:40:46.296492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18401): Terminated: ok {rc=0} 15:40:46.388416 bus /sierra_3: Setting Powered False 15:40:47.493357 bus /sierra_3: Setting Powered False 15:40:48.606605 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 15:40:49.848075 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:49.856301 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 15:40:49.878555 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 15:40:49.906938 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 15:40:49.958201 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 15:40:49.978710 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 15:40:50.005037 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 15:40:50.555384 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 15:40:50.602723 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:40:50.613810 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:40:50.668339 tst mo_mt_call.py: using LAC 22035 15:40:50.784380 tst mo_mt_call.py: using RAC 105 15:40:50.903544 tst mo_mt_call.py: using CellId 22035 15:40:51.018439 tst mo_mt_call.py: using BVCI 22036 15:40:51.126508 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:40:51.137509 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:40:51.148287 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:40:51.159395 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:40:51.170065 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:40:51.180685 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:40:51.295125 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:40:51.409067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:51.865166 run create_hlr_db(pid=18407): Launched 15:40:51.986154 bus /sierra_2: Setting Powered False 15:40:53.045558 run create_hlr_db(pid=18407): Terminated: ok {rc=0} 15:40:53.482303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18409): Launched 15:40:53.801614 run osmo-hlr_10.42.42.2(pid=18410): Launched 15:40:53.922856 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:54.469938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18412): Launched 15:40:54.789028 run osmo-stp_10.42.42.5(pid=18413): Launched 15:40:54.910320 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:55.487620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18415): Launched 15:40:55.805624 run osmo-msc_10.42.42.6(pid=18416): Launched 15:40:55.982614 run osmo-stp_10.42.42.5(pid=18413): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18413)] 15:40:56.115920 run osmo-stp_10.42.42.5(pid=18413): stdout: | (launched: 2022-12-09_15:40:54.730438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:56.250573 run osmo-stp_10.42.42.5(pid=18413): stderr: | [0;m[38;5;43m20221209154054922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154054922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154054923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154054923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154054924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154054924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154054924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:56.384523 run osmo-stp_10.42.42.5(pid=18413): stdout: | (launched: 2022-12-09_15:40:54.730438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:56.510747 run osmo-stp_10.42.42.5(pid=18413): stderr: | [0;m[38;5;43m20221209154054922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154054922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154054923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154054923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154054924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154054924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154054924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:56.661762 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18413): Process ended prematurely: osmo-stp_10.42.42.5(pid=18413) [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18413)] [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 15:40:56.671004 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 15:40:56.698413 run osmo-hlr_10.42.42.2(pid=18410): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18410)] 15:40:56.747803 run osmo-hlr_10.42.42.2(pid=18410): stdout: | (launched: 2022-12-09_15:40:53.742910) 15:40:56.798654 run osmo-hlr_10.42.42.2(pid=18410): stderr: | [0;m[1;31m20221209154053942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154053942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154053942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154053942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154053942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154053942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154053978 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154053988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154053988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154053988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:56.869424 run osmo-msc_10.42.42.6(pid=18416): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18416)] 15:40:56.918859 run osmo-msc_10.42.42.6(pid=18416): stdout: | (launched: 2022-12-09_15:40:55.747172) 15:40:56.969624 run osmo-msc_10.42.42.6(pid=18416): stderr: | [0;m[38;5;43m20221209154056067 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154056067 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f94e2b1ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154056067 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154056067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154056068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154056068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154056070 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154056070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154056070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154056070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:57.021295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18409): Terminating (SIGTERM) 15:40:57.062293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18412): Terminating (SIGTERM) 15:40:57.103304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18415): Terminating (SIGTERM) 15:40:57.145174 --- ParallelTerminationStrategy: PID 18409 died... 15:40:57.165095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18409): Terminated: ok {rc=0} 15:40:57.210648 --- ParallelTerminationStrategy: PID 18412 died... 15:40:57.229826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18412): Terminated: ok {rc=0} 15:40:57.275313 --- ParallelTerminationStrategy: PID 18415 died... 15:40:57.294642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18415): Terminated: ok {rc=0} 15:40:57.381648 bus /sierra_3: Setting Powered False 15:40:58.479938 bus /sierra_3: Setting Powered False 15:40:59.595016 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 15:41:00.740781 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:00.752762 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:41:00.811577 tst mo_mt_call_osmux.py: using LAC 22036 15:41:00.942948 tst mo_mt_call_osmux.py: using RAC 106 15:41:01.073365 tst mo_mt_call_osmux.py: using CellId 22036 15:41:01.194201 tst mo_mt_call_osmux.py: using BVCI 22037 15:41:01.321488 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:01.333027 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:01.344625 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:01.356188 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:01.368038 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:01.379579 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:41:01.498751 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:41:01.618458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:02.123645 run create_hlr_db(pid=18418): Launched 15:41:02.279257 bus /sierra_2: Setting Powered False 15:41:03.342352 run create_hlr_db(pid=18418): Terminated: ok {rc=0} 15:41:03.785800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18420): Launched 15:41:04.103920 run osmo-hlr_10.42.42.2(pid=18421): Launched 15:41:04.225328 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:04.773638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18423): Launched 15:41:05.092407 run osmo-stp_10.42.42.5(pid=18424): Launched 15:41:05.214162 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:05.788615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18426): Launched 15:41:06.106775 run osmo-msc_10.42.42.6(pid=18427): Launched 15:41:06.283464 run osmo-stp_10.42.42.5(pid=18424): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18424)] 15:41:06.417350 run osmo-stp_10.42.42.5(pid=18424): stdout: | (launched: 2022-12-09_15:41:05.033704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:06.551840 run osmo-stp_10.42.42.5(pid=18424): stderr: | [0;m[38;5;43m20221209154105226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154105226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154105227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154105227 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154105227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154105228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154105228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:06.685866 run osmo-stp_10.42.42.5(pid=18424): stdout: | (launched: 2022-12-09_15:41:05.033704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:06.812044 run osmo-stp_10.42.42.5(pid=18424): stderr: | [0;m[38;5;43m20221209154105226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154105226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154105227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154105227 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154105227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154105228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154105228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:06.963103 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18424): Process ended prematurely: osmo-stp_10.42.42.5(pid=18424) [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18424)] [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 15:41:06.972349 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:41:07.000048 run osmo-hlr_10.42.42.2(pid=18421): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18421)] 15:41:07.049586 run osmo-hlr_10.42.42.2(pid=18421): stdout: | (launched: 2022-12-09_15:41:04.045435) 15:41:07.100684 run osmo-hlr_10.42.42.2(pid=18421): stderr: | [0;m[1;31m20221209154104243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154104243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154104243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154104243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154104243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154104244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154104256 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154104264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154104265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154104265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:07.171760 run osmo-msc_10.42.42.6(pid=18427): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18427)] 15:41:07.221291 run osmo-msc_10.42.42.6(pid=18427): stdout: | (launched: 2022-12-09_15:41:06.048120) 15:41:07.272491 run osmo-msc_10.42.42.6(pid=18427): stderr: | [0;m[38;5;43m20221209154106370 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154106370 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc2fe701c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154106370 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154106370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154106371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154106371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154106372 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154106373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154106373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154106373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:07.324008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18420): Terminating (SIGTERM) 15:41:07.365121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18423): Terminating (SIGTERM) 15:41:07.406244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18426): Terminating (SIGTERM) 15:41:07.447286 --- ParallelTerminationStrategy: PID 18420 died... 15:41:07.466604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18420): Terminated: ok {rc=0} 15:41:07.512341 --- ParallelTerminationStrategy: PID 18423 died... 15:41:07.531649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18423): Terminated: ok {rc=0} 15:41:07.577689 --- ParallelTerminationStrategy: PID 18426 died... 15:41:07.597008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18426): Terminated: ok {rc=0} 15:41:07.684865 bus /sierra_3: Setting Powered False 15:41:08.783805 bus /sierra_3: Setting Powered False 15:41:09.900680 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 15:41:11.136312 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:41:11.143111 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 15:41:11.165147 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 15:41:11.192415 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 15:41:11.244778 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 15:41:11.266206 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 15:41:11.293919 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 15:41:11.844598 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 15:41:11.896100 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:11.907782 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:41:11.965278 tst mo_mt_call.py: using LAC 22037 15:41:12.090054 tst mo_mt_call.py: using RAC 107 15:41:12.213638 tst mo_mt_call.py: using CellId 22037 15:41:12.339887 tst mo_mt_call.py: using BVCI 22038 15:41:12.456585 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:12.468074 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:12.479198 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:12.490717 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:12.502273 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:12.513725 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:41:12.630001 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:41:12.749605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:13.241898 run create_hlr_db(pid=18432): Launched 15:41:13.365105 bus /sierra_2: Setting Powered False 15:41:14.427867 run create_hlr_db(pid=18432): Terminated: ok {rc=0} 15:41:14.854177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18434): Launched 15:41:15.149765 run osmo-hlr_10.42.42.2(pid=18435): Launched 15:41:15.261214 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:15.785935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18437): Launched 15:41:16.126866 run osmo-stp_10.42.42.5(pid=18438): Launched 15:41:16.368348 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:17.045679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18440): Launched 15:41:17.371683 run osmo-msc_10.42.42.6(pid=18441): Launched 15:41:17.549109 run osmo-stp_10.42.42.5(pid=18438): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18438)] 15:41:17.683897 run osmo-stp_10.42.42.5(pid=18438): stdout: | (launched: 2022-12-09_15:41:16.063732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:17.820939 run osmo-stp_10.42.42.5(pid=18438): stderr: | [0;m[38;5;43m20221209154116355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154116355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154116369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154116369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154116372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154116372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154116372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:17.954957 run osmo-stp_10.42.42.5(pid=18438): stdout: | (launched: 2022-12-09_15:41:16.063732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:18.081784 run osmo-stp_10.42.42.5(pid=18438): stderr: | [0;m[38;5;43m20221209154116355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154116355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154116369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154116369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154116372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154116372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154116372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:18.232880 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18438): Process ended prematurely: osmo-stp_10.42.42.5(pid=18438) [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18438)] [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 15:41:18.242400 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 15:41:18.270208 run osmo-hlr_10.42.42.2(pid=18435): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18435)] 15:41:18.319954 run osmo-hlr_10.42.42.2(pid=18435): stdout: | (launched: 2022-12-09_15:41:15.094996) 15:41:18.371224 run osmo-hlr_10.42.42.2(pid=18435): stderr: | [0;m[1;31m20221209154115269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154115270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154115270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154115270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154115270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154115270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154115281 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154115291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154115291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154115291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:18.442146 run osmo-msc_10.42.42.6(pid=18441): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18441)] 15:41:18.491356 run osmo-msc_10.42.42.6(pid=18441): stdout: | (launched: 2022-12-09_15:41:17.313079) 15:41:18.542401 run osmo-msc_10.42.42.6(pid=18441): stderr: | [0;m[38;5;43m20221209154117633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154117634 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc662641c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154117634 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154117634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154117634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154117634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154117636 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154117636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154117636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154117636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:18.593559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18434): Terminating (SIGTERM) 15:41:18.635259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18437): Terminating (SIGTERM) 15:41:18.676891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18440): Terminating (SIGTERM) 15:41:18.718649 --- ParallelTerminationStrategy: PID 18434 died... 15:41:18.738267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18434): Terminated: ok {rc=0} 15:41:18.784476 --- ParallelTerminationStrategy: PID 18437 died... 15:41:18.804237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18437): Terminated: ok {rc=0} 15:41:18.850477 --- ParallelTerminationStrategy: PID 18440 died... 15:41:18.869947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18440): Terminated: ok {rc=0} 15:41:18.957743 bus /sierra_3: Setting Powered False 15:41:20.057068 bus /sierra_3: Setting Powered False 15:41:21.172323 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 15:41:22.312451 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:22.324208 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:41:22.388041 tst mo_mt_call_osmux.py: using LAC 22038 15:41:22.504420 tst mo_mt_call_osmux.py: using RAC 108 15:41:22.618563 tst mo_mt_call_osmux.py: using CellId 22038 15:41:22.732065 tst mo_mt_call_osmux.py: using BVCI 22039 15:41:22.838494 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:22.849730 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:22.860566 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:22.871637 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:22.882765 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:41:22.893922 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:41:23.007492 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:41:23.130578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:23.625033 run create_hlr_db(pid=18443): Launched 15:41:23.746564 bus /sierra_2: Setting Powered False 15:41:24.809652 run create_hlr_db(pid=18443): Terminated: ok {rc=0} 15:41:25.234990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18445): Launched 15:41:25.531924 run osmo-hlr_10.42.42.2(pid=18446): Launched 15:41:25.644090 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:26.150934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18448): Launched 15:41:26.446200 run osmo-stp_10.42.42.5(pid=18449): Launched 15:41:26.557586 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:27.092252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18451): Launched 15:41:27.389712 run osmo-msc_10.42.42.6(pid=18452): Launched 15:41:27.555486 run osmo-stp_10.42.42.5(pid=18449): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18449)] 15:41:27.680382 run osmo-stp_10.42.42.5(pid=18449): stdout: | (launched: 2022-12-09_15:41:26.391162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:27.805458 run osmo-stp_10.42.42.5(pid=18449): stderr: | [0;m[38;5;43m20221209154126562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154126563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154126563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154126563 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154126564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154126564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154126564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:27.928437 run osmo-stp_10.42.42.5(pid=18449): stdout: | (launched: 2022-12-09_15:41:26.391162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:28.046223 run osmo-stp_10.42.42.5(pid=18449): stderr: | [0;m[38;5;43m20221209154126562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154126563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154126563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154126563 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154126564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154126564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154126564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:28.187288 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18449): Process ended prematurely: osmo-stp_10.42.42.5(pid=18449) [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18449)] [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 15:41:28.196180 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 15:41:28.222184 run osmo-hlr_10.42.42.2(pid=18446): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18446)] 15:41:28.269671 run osmo-hlr_10.42.42.2(pid=18446): stdout: | (launched: 2022-12-09_15:41:25.477354) 15:41:28.318659 run osmo-hlr_10.42.42.2(pid=18446): stderr: | [0;m[1;31m20221209154125653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154125653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154125653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154125653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154125653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154125653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154125665 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154125674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154125674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154125674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:28.386557 run osmo-msc_10.42.42.6(pid=18452): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18452)] 15:41:28.433612 run osmo-msc_10.42.42.6(pid=18452): stdout: | (launched: 2022-12-09_15:41:27.333611) 15:41:28.482492 run osmo-msc_10.42.42.6(pid=18452): stderr: | [0;m[38;5;43m20221209154127607 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154127607 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f983b810c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154127607 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154127607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154127608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154127608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154127610 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154127610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154127611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154127611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:28.531604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18445): Terminating (SIGTERM) 15:41:28.570969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18448): Terminating (SIGTERM) 15:41:28.610729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18451): Terminating (SIGTERM) 15:41:28.650110 --- ParallelTerminationStrategy: PID 18445 died... 15:41:28.668739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18445): Terminated: ok {rc=0} 15:41:28.712179 --- ParallelTerminationStrategy: PID 18448 died... 15:41:28.730881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18448): Terminated: ok {rc=0} 15:41:28.774120 --- ParallelTerminationStrategy: PID 18451 died... 15:41:28.792261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18451): Terminated: ok {rc=0} 15:41:28.876772 bus /sierra_3: Setting Powered False 15:41:29.974754 bus /sierra_3: Setting Powered False 15:41:31.092494 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:41:32.355625 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:41:32.362586 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:41:32.384303 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 15:41:32.412021 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:41:32.464585 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:41:32.485723 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 15:41:32.513090 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:41:33.064312 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 15:41:33.115727 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:33.127086 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:41:33.184047 tst mo_mt_call.py: using LAC 22039 15:41:33.309791 tst mo_mt_call.py: using RAC 109 15:41:33.434077 tst mo_mt_call.py: using CellId 22039 15:41:33.560116 tst mo_mt_call.py: using BVCI 22040 15:41:33.668245 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:33.679417 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:33.690436 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:33.701948 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:33.713094 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:33.724505 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:41:33.843277 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:41:33.964014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:34.459253 run create_hlr_db(pid=18457): Launched 15:41:34.580666 bus /sierra_2: Setting Powered False 15:41:35.643971 run create_hlr_db(pid=18457): Terminated: ok {rc=0} 15:41:36.091368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18459): Launched 15:41:36.411915 run osmo-hlr_10.42.42.2(pid=18460): Launched 15:41:36.533487 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:37.082980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18462): Launched 15:41:37.403000 run osmo-stp_10.42.42.5(pid=18463): Launched 15:41:37.524547 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:38.099555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18465): Launched 15:41:38.420142 run osmo-msc_10.42.42.6(pid=18466): Launched 15:41:38.597432 run osmo-stp_10.42.42.5(pid=18463): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18463)] 15:41:38.731568 run osmo-stp_10.42.42.5(pid=18463): stdout: | (launched: 2022-12-09_15:41:37.344139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:38.867122 run osmo-stp_10.42.42.5(pid=18463): stderr: | [0;m[38;5;43m20221209154137539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154137539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154137539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154137540 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154137540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154137540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154137540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:39.001531 run osmo-stp_10.42.42.5(pid=18463): stdout: | (launched: 2022-12-09_15:41:37.344139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:39.128357 run osmo-stp_10.42.42.5(pid=18463): stderr: | [0;m[38;5;43m20221209154137539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154137539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154137539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154137540 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154137540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154137540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154137540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:39.280184 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18463): Process ended prematurely: osmo-stp_10.42.42.5(pid=18463) [trial-2361↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18463)] [trial-2361↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 15:41:39.289723 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:41:39.317828 run osmo-hlr_10.42.42.2(pid=18460): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18460)] 15:41:39.367734 run osmo-hlr_10.42.42.2(pid=18460): stdout: | (launched: 2022-12-09_15:41:36.353305) 15:41:39.419128 run osmo-hlr_10.42.42.2(pid=18460): stderr: | [0;m[1;31m20221209154136551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154136551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154136552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154136552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154136552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154136552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154136563 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154136571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154136571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154136571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:39.490591 run osmo-msc_10.42.42.6(pid=18466): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18466)] 15:41:39.539804 run osmo-msc_10.42.42.6(pid=18466): stdout: | (launched: 2022-12-09_15:41:38.361298) 15:41:39.590754 run osmo-msc_10.42.42.6(pid=18466): stderr: | [0;m[38;5;43m20221209154138684 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154138684 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f28ae866c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154138685 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154138685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154138685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154138685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154138688 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154138689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154138689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154138689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:39.641820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18459): Terminating (SIGTERM) 15:41:39.682906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18462): Terminating (SIGTERM) 15:41:39.724505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18465): Terminating (SIGTERM) 15:41:39.765833 --- ParallelTerminationStrategy: PID 18459 died... 15:41:39.785470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18459): Terminated: ok {rc=0} 15:41:39.831097 --- ParallelTerminationStrategy: PID 18462 died... 15:41:39.850380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18462): Terminated: ok {rc=0} 15:41:39.896095 --- ParallelTerminationStrategy: PID 18465 died... 15:41:39.915348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18465): Terminated: ok {rc=0} 15:41:40.001720 bus /sierra_3: Setting Powered False 15:41:41.099989 bus /sierra_3: Setting Powered False 15:41:42.215609 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 15:41:43.358714 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:43.370505 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:41:43.427366 tst mo_mt_call_osmux.py: using LAC 22040 15:41:43.544386 tst mo_mt_call_osmux.py: using RAC 110 15:41:43.672688 tst mo_mt_call_osmux.py: using CellId 22040 15:41:43.789925 tst mo_mt_call_osmux.py: using BVCI 22041 15:41:43.896282 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:43.907386 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:43.918277 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:43.929261 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:43.939980 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:41:43.950845 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:41:44.068566 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:41:44.186120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:44.644241 run create_hlr_db(pid=18468): Launched 15:41:44.763633 bus /sierra_2: Setting Powered False 15:41:45.822827 run create_hlr_db(pid=18468): Terminated: ok {rc=0} 15:41:46.333684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18470): Launched 15:41:46.669646 run osmo-hlr_10.42.42.2(pid=18471): Launched 15:41:46.851389 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:47.538963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18473): Launched 15:41:47.857140 run osmo-stp_10.42.42.5(pid=18474): Launched 15:41:47.979308 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:48.555153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18476): Launched 15:41:48.876254 run osmo-msc_10.42.42.6(pid=18477): Launched 15:41:49.053308 run osmo-stp_10.42.42.5(pid=18474): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18474)] 15:41:49.186538 run osmo-stp_10.42.42.5(pid=18474): stdout: | (launched: 2022-12-09_15:41:47.798533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:49.320900 run osmo-stp_10.42.42.5(pid=18474): stderr: | [0;m[38;5;43m20221209154147991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154147991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154147991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154147992 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154147992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154147992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154147992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:49.455137 run osmo-stp_10.42.42.5(pid=18474): stdout: | (launched: 2022-12-09_15:41:47.798533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:49.581650 run osmo-stp_10.42.42.5(pid=18474): stderr: | [0;m[38;5;43m20221209154147991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154147991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154147991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154147992 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154147992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154147992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154147992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:49.733012 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18474): Process ended prematurely: osmo-stp_10.42.42.5(pid=18474) [trial-2361↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18474)] [trial-2361↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 15:41:49.742476 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 15:41:49.770174 run osmo-hlr_10.42.42.2(pid=18471): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18471)] 15:41:49.819657 run osmo-hlr_10.42.42.2(pid=18471): stdout: | (launched: 2022-12-09_15:41:46.606860) 15:41:49.870628 run osmo-hlr_10.42.42.2(pid=18471): stderr: | [0;m[1;31m20221209154146952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154146952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154146952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154146952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154146952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154146952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154146972 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154146987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154146988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154146988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:49.941642 run osmo-msc_10.42.42.6(pid=18477): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18477)] 15:41:49.990884 run osmo-msc_10.42.42.6(pid=18477): stdout: | (launched: 2022-12-09_15:41:48.817454) 15:41:50.041623 run osmo-msc_10.42.42.6(pid=18477): stderr: | [0;m[38;5;43m20221209154149141 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154149141 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f73d3eeec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154149142 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154149142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154149142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154149142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154149144 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154149144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154149144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154149144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:50.092796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18470): Terminating (SIGTERM) 15:41:50.134070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18473): Terminating (SIGTERM) 15:41:50.175202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18476): Terminating (SIGTERM) 15:41:50.216573 --- ParallelTerminationStrategy: PID 18470 died... 15:41:50.236303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18470): Terminated: ok {rc=0} 15:41:50.282263 --- ParallelTerminationStrategy: PID 18473 died... 15:41:50.301465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18473): Terminated: ok {rc=0} 15:41:50.347458 --- ParallelTerminationStrategy: PID 18476 died... 15:41:50.366887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18476): Terminated: ok {rc=0} 15:41:50.453137 bus /sierra_3: Setting Powered False 15:41:51.550668 bus /sierra_3: Setting Powered False 15:41:52.664339 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:41:53.899925 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:41:53.905844 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:41:53.927004 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 15:41:53.954745 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 15:41:54.007766 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:41:54.028741 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 15:41:54.055985 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 15:41:54.605599 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 15:41:54.655702 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:41:54.666644 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:41:54.724122 tst mo_mt_call.py: using LAC 22041 15:41:54.844285 tst mo_mt_call.py: using RAC 111 15:41:54.960757 tst mo_mt_call.py: using CellId 22041 15:41:55.075225 tst mo_mt_call.py: using BVCI 22042 15:41:55.181896 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:41:55.192576 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:41:55.203100 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:41:55.214177 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:41:55.225280 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:41:55.236319 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:41:55.356833 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:41:55.478183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:55.973050 run create_hlr_db(pid=18483): Launched 15:41:56.094159 bus /sierra_2: Setting Powered False 15:41:57.156933 run create_hlr_db(pid=18483): Terminated: ok {rc=0} 15:41:57.603025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18485): Launched 15:41:57.922991 run osmo-hlr_10.42.42.2(pid=18486): Launched 15:41:58.044632 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:58.599427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18488): Launched 15:41:58.921850 run osmo-stp_10.42.42.5(pid=18489): Launched 15:41:59.044891 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:59.626051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18491): Launched 15:41:59.946125 run osmo-msc_10.42.42.6(pid=18492): Launched 15:42:00.123795 run osmo-stp_10.42.42.5(pid=18489): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18489)] 15:42:00.258717 run osmo-stp_10.42.42.5(pid=18489): stdout: | (launched: 2022-12-09_15:41:58.862530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:00.394762 run osmo-stp_10.42.42.5(pid=18489): stderr: | [0;m[38;5;43m20221209154159056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154159056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154159057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154159057 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154159058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154159058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154159058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:00.529513 run osmo-stp_10.42.42.5(pid=18489): stdout: | (launched: 2022-12-09_15:41:58.862530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:00.657204 run osmo-stp_10.42.42.5(pid=18489): stderr: | [0;m[38;5;43m20221209154159056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154159056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154159057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154159057 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154159058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154159058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154159058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:00.809767 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18489): Process ended prematurely: osmo-stp_10.42.42.5(pid=18489) [trial-2361↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18489)] [trial-2361↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 15:42:00.819126 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:42:00.849649 run osmo-hlr_10.42.42.2(pid=18486): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18486)] 15:42:00.927050 run osmo-hlr_10.42.42.2(pid=18486): stdout: | (launched: 2022-12-09_15:41:57.864189) 15:42:00.984776 run osmo-hlr_10.42.42.2(pid=18486): stderr: | [0;m[1;31m20221209154158063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154158063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154158063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154158063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154158063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154158063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154158075 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154158083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154158083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154158084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:01.102468 run osmo-msc_10.42.42.6(pid=18492): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18492)] 15:42:01.154216 run osmo-msc_10.42.42.6(pid=18492): stdout: | (launched: 2022-12-09_15:41:59.887150) 15:42:01.207740 run osmo-msc_10.42.42.6(pid=18492): stderr: | [0;m[38;5;43m20221209154200212 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154200212 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc64eb2ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154200212 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154200212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154200212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154200212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154200214 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154200214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154200214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154200215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:01.261570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18485): Terminating (SIGTERM) 15:42:01.305309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18488): Terminating (SIGTERM) 15:42:01.349848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18491): Terminating (SIGTERM) 15:42:01.395315 --- ParallelTerminationStrategy: PID 18485 died... 15:42:01.415511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18485): Terminated: ok {rc=0} 15:42:01.464304 --- ParallelTerminationStrategy: PID 18488 died... 15:42:01.484499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18488): Terminated: ok {rc=0} 15:42:01.533138 --- ParallelTerminationStrategy: PID 18491 died... 15:42:01.553234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18491): Terminated: ok {rc=0} 15:42:01.649332 bus /sierra_3: Setting Powered False 15:42:02.754217 bus /sierra_3: Setting Powered False 15:42:03.868617 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 15:42:05.011946 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:05.023298 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:42:05.080257 tst mo_mt_call_osmux.py: using LAC 22042 15:42:05.198256 tst mo_mt_call_osmux.py: using RAC 112 15:42:05.314232 tst mo_mt_call_osmux.py: using CellId 22042 15:42:05.444028 tst mo_mt_call_osmux.py: using BVCI 22043 15:42:05.561593 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:05.572917 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:05.583928 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:05.595364 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:05.606669 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:05.618025 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:42:05.733570 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:42:05.852804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:06.349202 run create_hlr_db(pid=18501): Launched 15:42:06.470415 bus /sierra_2: Setting Powered False 15:42:07.533683 run create_hlr_db(pid=18501): Terminated: ok {rc=0} 15:42:07.962572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18503): Launched 15:42:08.261998 run osmo-hlr_10.42.42.2(pid=18504): Launched 15:42:08.374702 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:08.890870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18506): Launched 15:42:09.190036 run osmo-stp_10.42.42.5(pid=18507): Launched 15:42:09.304484 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:09.844733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18509): Launched 15:42:10.142439 run osmo-msc_10.42.42.6(pid=18510): Launched 15:42:10.307690 run osmo-stp_10.42.42.5(pid=18507): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18507)] 15:42:10.433368 run osmo-stp_10.42.42.5(pid=18507): stdout: | (launched: 2022-12-09_15:42:09.133737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:10.558855 run osmo-stp_10.42.42.5(pid=18507): stderr: | [0;m[38;5;43m20221209154209303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154209304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154209304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154209304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154209305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154209305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154209305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:10.682421 run osmo-stp_10.42.42.5(pid=18507): stdout: | (launched: 2022-12-09_15:42:09.133737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:10.799999 run osmo-stp_10.42.42.5(pid=18507): stderr: | [0;m[38;5;43m20221209154209303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154209304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154209304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154209304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154209305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154209305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154209305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:10.941653 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18507): Process ended prematurely: osmo-stp_10.42.42.5(pid=18507) [trial-2361↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18507)] [trial-2361↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 15:42:10.950115 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 15:42:10.975609 run osmo-hlr_10.42.42.2(pid=18504): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18504)] 15:42:11.022382 run osmo-hlr_10.42.42.2(pid=18504): stdout: | (launched: 2022-12-09_15:42:08.206376) 15:42:11.070627 run osmo-hlr_10.42.42.2(pid=18504): stderr: | [0;m[1;31m20221209154208383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154208383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154208383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154208383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154208383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154208383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154208396 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154208407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154208407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154208407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:11.138098 run osmo-msc_10.42.42.6(pid=18510): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18510)] 15:42:11.184840 run osmo-msc_10.42.42.6(pid=18510): stdout: | (launched: 2022-12-09_15:42:10.086991) 15:42:11.233290 run osmo-msc_10.42.42.6(pid=18510): stderr: | [0;m[38;5;43m20221209154210358 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154210358 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb67a12bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154210358 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154210358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154210359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154210359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154210361 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154210361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154210361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154210361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:11.282107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18503): Terminating (SIGTERM) 15:42:11.321025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18506): Terminating (SIGTERM) 15:42:11.360066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18509): Terminating (SIGTERM) 15:42:11.399358 --- ParallelTerminationStrategy: PID 18503 died... 15:42:11.418082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18503): Terminated: ok {rc=0} 15:42:11.461327 --- ParallelTerminationStrategy: PID 18506 died... 15:42:11.479560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18506): Terminated: ok {rc=0} 15:42:11.522859 --- ParallelTerminationStrategy: PID 18509 died... 15:42:11.541085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18509): Terminated: ok {rc=0} 15:42:11.623744 bus /sierra_3: Setting Powered False 15:42:12.720118 bus /sierra_3: Setting Powered False 15:42:13.833592 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 emergency:sysmo --------------------------------------------------------------------- 15:42:15.061733 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:42:15.066297 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 15:42:15.087915 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 15:42:15.115300 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 15:42:15.199897 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 15:42:15.221172 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 15:42:15.248198 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 15:42:15.835045 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2361 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 15:42:15.847430 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:15.860426 tst emergency:sysmo: Using 1 x bts (candidates: 1) 15:42:15.903169 tst emergency_mo_mt_call.py: using LAC 22043 15:42:16.046003 tst emergency_mo_mt_call.py: using RAC 113 15:42:16.170711 tst emergency_mo_mt_call.py: using CellId 22043 15:42:16.295731 tst emergency_mo_mt_call.py: using BVCI 22044 15:42:16.414406 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:16.426501 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:16.438416 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:16.451029 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:16.463352 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:16.476197 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:42:16.599524 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:42:16.712535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:17.189489 run create_hlr_db(pid=18515): Launched 15:42:17.337405 bus /sierra_2: Setting Powered False 15:42:18.396176 run create_hlr_db(pid=18515): Terminated: ok {rc=0} 15:42:18.833793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18517): Launched 15:42:19.127260 run osmo-hlr_10.42.42.2(pid=18518): Launched 15:42:19.237395 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:19.755194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18520): Launched 15:42:20.049894 run osmo-stp_10.42.42.5(pid=18521): Launched 15:42:20.169845 tst emergency_mo_mt_call.py: using MSISDN 7257 15:42:20.318913 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:20.844720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18523): Launched 15:42:21.136601 run osmo-msc_10.42.42.6(pid=18524): Launched 15:42:21.299093 run osmo-stp_10.42.42.5(pid=18521): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18521)] 15:42:21.422491 run osmo-stp_10.42.42.5(pid=18521): stdout: | (launched: 2022-12-09_15:42:19.994823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:21.547805 run osmo-stp_10.42.42.5(pid=18521): stderr: | [0;m[38;5;43m20221209154220166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154220166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154220166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154220167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154220167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154220167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154220167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:21.669212 run osmo-stp_10.42.42.5(pid=18521): stdout: | (launched: 2022-12-09_15:42:19.994823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:21.785999 run osmo-stp_10.42.42.5(pid=18521): stderr: | [0;m[38;5;43m20221209154220166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154220166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154220166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154220167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154220167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154220167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154220167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:21.926667 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=18521): Process ended prematurely: osmo-stp_10.42.42.5(pid=18521) [trial-2361↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18521)] [trial-2361↪emergency:sysmo↪emergency_mo_mt_call.py:19] 15:42:21.934597 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 15:42:21.960018 run osmo-hlr_10.42.42.2(pid=18518): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18518)] 15:42:22.007263 run osmo-hlr_10.42.42.2(pid=18518): stdout: | (launched: 2022-12-09_15:42:19.072582) 15:42:22.056498 run osmo-hlr_10.42.42.2(pid=18518): stderr: | [0;m[1;31m20221209154219248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154219248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154219248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154219248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154219248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154219248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154219260 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154219269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154219269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154219269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:22.124755 run osmo-msc_10.42.42.6(pid=18524): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18524)] 15:42:22.172018 run osmo-msc_10.42.42.6(pid=18524): stdout: | (launched: 2022-12-09_15:42:21.081717) 15:42:22.220810 run osmo-msc_10.42.42.6(pid=18524): stderr: | [0;m[38;5;43m20221209154221357 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154221357 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb76da76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154221357 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154221357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154221357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154221358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154221359 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154221360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154221360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154221360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:22.270132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18517): Terminating (SIGTERM) 15:42:22.309579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18520): Terminating (SIGTERM) 15:42:22.348802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18523): Terminating (SIGTERM) 15:42:22.388189 --- ParallelTerminationStrategy: PID 18517 died... 15:42:22.407071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18517): Terminated: ok {rc=0} 15:42:22.450684 --- ParallelTerminationStrategy: PID 18520 died... 15:42:22.469005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18520): Terminated: ok {rc=0} 15:42:22.512322 --- ParallelTerminationStrategy: PID 18523 died... 15:42:22.530704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18523): Terminated: ok {rc=0} 15:42:22.615553 bus /sierra_3: Setting Powered False 15:42:23.713170 bus /sierra_3: Setting Powered False 15:42:24.827107 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 15:42:25.914284 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:25.925434 tst emergency:sysmo: Using 1 x bts (candidates: 1) 15:42:25.965741 tst emergency_preemptive_call.py: using LAC 22044 15:42:26.081924 tst emergency_preemptive_call.py: using RAC 114 15:42:26.194626 tst emergency_preemptive_call.py: using CellId 22044 15:42:26.307538 tst emergency_preemptive_call.py: using BVCI 22045 15:42:26.412537 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:26.423085 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:26.433479 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:26.443764 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:26.454088 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:42:26.464248 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:42:26.581444 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:42:26.700259 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:42:26.814425 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:42:26.927689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:27.417171 run create_hlr_db(pid=18526): Launched 15:42:27.536431 bus /sierra_2: Setting Powered False 15:42:28.598645 run create_hlr_db(pid=18526): Terminated: ok {rc=0} 15:42:29.038964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18528): Launched 15:42:29.355639 run osmo-hlr_10.42.42.2(pid=18529): Launched 15:42:29.476443 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:30.024297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18531): Launched 15:42:30.321631 run osmo-stp_10.42.42.5(pid=18532): Launched 15:42:30.441825 tst emergency_preemptive_call.py: using MSISDN 7258 15:42:30.590106 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:31.145683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18534): Launched 15:42:31.450945 run osmo-msc_10.42.42.6(pid=18535): Launched 15:42:31.822053 run osmo-stp_10.42.42.5(pid=18532): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18532)] 15:42:31.953461 run osmo-stp_10.42.42.5(pid=18532): stdout: | (launched: 2022-12-09_15:42:30.266611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:32.221940 run osmo-stp_10.42.42.5(pid=18532): stderr: | [0;m[38;5;43m20221209154230435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154230435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154230436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154230436 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154230437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154230437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154230437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:32.377506 run osmo-stp_10.42.42.5(pid=18532): stdout: | (launched: 2022-12-09_15:42:30.266611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:32.505490 run osmo-stp_10.42.42.5(pid=18532): stderr: | [0;m[38;5;43m20221209154230435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154230435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154230436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154230436 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154230437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154230437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154230437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:32.655843 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=18532): Process ended prematurely: osmo-stp_10.42.42.5(pid=18532) [trial-2361↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18532)] [trial-2361↪emergency:sysmo↪emergency_preemptive_call.py:32] 15:42:32.664639 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 15:42:32.691603 run osmo-hlr_10.42.42.2(pid=18529): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18529)] 15:42:32.741349 run osmo-hlr_10.42.42.2(pid=18529): stdout: | (launched: 2022-12-09_15:42:29.296898) 15:42:32.792389 run osmo-hlr_10.42.42.2(pid=18529): stderr: | [0;m[1;31m20221209154229493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154229493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154229493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154229493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154229493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154229494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154229506 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154229516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154229516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154229516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:32.863561 run osmo-msc_10.42.42.6(pid=18535): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18535)] 15:42:32.912885 run osmo-msc_10.42.42.6(pid=18535): stdout: | (launched: 2022-12-09_15:42:31.389105) 15:42:32.964108 run osmo-msc_10.42.42.6(pid=18535): stderr: | [0;m[38;5;43m20221209154231886 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154231886 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe79c333c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154231886 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154231886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154231886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154231887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154231901 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154231902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154231902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154231902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:33.015551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18528): Terminating (SIGTERM) 15:42:33.056540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18531): Terminating (SIGTERM) 15:42:33.097714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18534): Terminating (SIGTERM) 15:42:33.139236 --- ParallelTerminationStrategy: PID 18528 died... 15:42:33.158841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18528): Terminated: ok {rc=0} 15:42:33.204526 --- ParallelTerminationStrategy: PID 18531 died... 15:42:33.223693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18531): Terminated: ok {rc=0} 15:42:33.269458 --- ParallelTerminationStrategy: PID 18534 died... 15:42:33.288534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18534): Terminated: ok {rc=0} 15:42:33.376040 bus /sierra_9: Setting Powered False 15:42:34.470948 bus /sierra_9: Setting Powered False 15:42:35.581021 bus /sierra_8: Setting Powered False 15:42:36.677537 bus /sierra_8: Setting Powered False 15:42:37.792188 bus /sierra_3: Setting Powered False 15:42:38.885318 bus /sierra_3: Setting Powered False 15:42:39.998436 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:sysmo --------------------------------------------------------------------- 15:42:41.250875 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:42:41.256264 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 15:42:41.277773 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 15:42:41.317741 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 15:42:41.405746 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 15:42:41.426754 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 15:42:41.466110 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 15:42:42.058742 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 15:42:42.112032 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:42.122874 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:42:42.157374 tst cs_paging_gprs_active.py: using LAC 22045 15:42:42.282030 tst cs_paging_gprs_active.py: using RAC 115 15:42:42.406038 tst cs_paging_gprs_active.py: using CellId 22045 15:42:42.530013 tst cs_paging_gprs_active.py: using BVCI 22046 15:42:42.638171 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:42.648576 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:42.658919 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:42.669344 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:42.679475 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:42.689761 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:42.699993 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:42.710237 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:42.720573 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:42:42.836191 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:42:42.956699 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:42:43.173109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:42:43.495626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18540): Launched 15:42:43.775734 run iperf3-srv_10.42.42.10(pid=18541): Launched 15:42:43.895960 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:42:44.112290 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:42:44.434691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18542): Launched 15:42:44.714119 run iperf3-srv_10.42.42.10(pid=18543): Launched 15:42:44.833857 tst cs_paging_gprs_active.py:38: start network... 15:42:45.050033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:45.547355 run create_hlr_db(pid=18544): Launched 15:42:45.672221 bus /sierra_2: Setting Powered False 15:42:46.733836 run create_hlr_db(pid=18544): Terminated: ok {rc=0} 15:42:47.177379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18546): Launched 15:42:47.485180 run osmo-hlr_10.42.42.2(pid=18547): Launched 15:42:47.599226 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:48.126876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18549): Launched 15:42:48.425081 run osmo-stp_10.42.42.5(pid=18550): Launched 15:42:48.536802 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:42:50.019569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18552): Launched 15:42:50.135109 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:42:50.389389 run patchelf(pid=18553): Launched 15:42:50.556564 run osmo-stp_10.42.42.5(pid=18550): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18550)] 15:42:50.683029 run osmo-stp_10.42.42.5(pid=18550): stdout: | (launched: 2022-12-09_15:42:48.369265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:50.811247 run osmo-stp_10.42.42.5(pid=18550): stderr: | [0;m[38;5;43m20221209154248539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154248539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154248539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154248540 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154248542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154248542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154248542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:50.939240 run osmo-stp_10.42.42.5(pid=18550): stdout: | (launched: 2022-12-09_15:42:48.369265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:51.061105 run osmo-stp_10.42.42.5(pid=18550): stderr: | [0;m[38;5;43m20221209154248539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154248539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154248539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154248540 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154248542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154248542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154248542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:51.205399 run patchelf(pid=18553): Terminating (SIGINT) 15:42:51.373816 run patchelf(pid=18553): Terminated: ok {rc=0} 15:42:51.494713 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18550): Process ended prematurely: osmo-stp_10.42.42.5(pid=18550) [trial-2361↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18550)] [trial-2361↪gprs:sysmo↪cs_paging_gprs_active.py:38] 15:42:51.503779 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 15:42:51.530459 run osmo-hlr_10.42.42.2(pid=18547): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18547)] 15:42:51.577391 run osmo-hlr_10.42.42.2(pid=18547): stdout: | (launched: 2022-12-09_15:42:47.429690) 15:42:51.626069 run osmo-hlr_10.42.42.2(pid=18547): stderr: | [0;m[1;31m20221209154247607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154247607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154247607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154247607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154247607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154247607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154247620 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154247629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154247629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154247629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:51.675194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18540): Terminating (SIGTERM) 15:42:51.714464 run iperf3-srv_10.42.42.10(pid=18541): Terminating (SIGTERM) 15:42:51.753584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18542): Terminating (SIGTERM) 15:42:51.792605 run iperf3-srv_10.42.42.10(pid=18543): Terminating (SIGTERM) 15:42:51.831621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18546): Terminating (SIGTERM) 15:42:51.870851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18549): Terminating (SIGTERM) 15:42:51.910147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18552): Terminating (SIGTERM) 15:42:51.950191 --- ParallelTerminationStrategy: PID 18540 died... 15:42:51.969039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18540): Terminated: ok {rc=0} 15:42:52.012591 --- ParallelTerminationStrategy: PID 18541 died... 15:42:52.030892 run iperf3-srv_10.42.42.10(pid=18541): Terminated {rc=256} 15:42:52.074901 --- ParallelTerminationStrategy: PID 18542 died... 15:42:52.093353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18542): Terminated: ok {rc=0} 15:42:52.136825 --- ParallelTerminationStrategy: PID 18543 died... 15:42:52.155596 run iperf3-srv_10.42.42.10(pid=18543): Terminated {rc=256} 15:42:52.199037 --- ParallelTerminationStrategy: PID 18546 died... 15:42:52.217381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18546): Terminated: ok {rc=0} 15:42:52.260813 --- ParallelTerminationStrategy: PID 18549 died... 15:42:52.279642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18549): Terminated: ok {rc=0} 15:42:52.323166 --- ParallelTerminationStrategy: PID 18552 died... 15:42:52.341523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18552): Terminated: ok {rc=0} 15:42:52.425689 bus /gobi_0: Setting Powered False 15:42:53.526267 bus /gobi_0: Setting Powered False 15:42:54.639987 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo iperf3.py ---------------------------------------------- 15:42:55.784936 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:55.796381 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:42:55.831545 tst iperf3.py: using LAC 22046 15:42:55.949678 tst iperf3.py: using RAC 116 15:42:56.065757 tst iperf3.py: using CellId 22046 15:42:56.183956 tst iperf3.py: using BVCI 22047 15:42:56.293728 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:56.304107 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:56.314470 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:56.324729 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:56.334974 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:56.345219 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:56.355552 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:56.365870 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:42:56.376154 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:42:56.494399 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:42:56.711500 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:42:57.034774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18554): Launched 15:42:57.314576 run iperf3-srv_10.42.42.10(pid=18555): Launched 15:42:57.434910 tst iperf3.py:8: start network... 15:42:57.651402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:58.147435 run create_hlr_db(pid=18556): Launched 15:42:58.269588 bus /gobi_6: Setting Powered False 15:42:59.332216 run create_hlr_db(pid=18556): Terminated: ok {rc=0} 15:42:59.760249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18558): Launched 15:43:00.058848 run osmo-hlr_10.42.42.2(pid=18559): Launched 15:43:00.172594 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:00.686544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18561): Launched 15:43:01.005894 run osmo-stp_10.42.42.5(pid=18562): Launched 15:43:01.213551 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:43:01.894327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18564): Launched 15:43:02.022456 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:43:02.300654 run patchelf(pid=18565): Launched 15:43:02.480081 run osmo-stp_10.42.42.5(pid=18562): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18562)] 15:43:02.616365 run osmo-stp_10.42.42.5(pid=18562): stdout: | (launched: 2022-12-09_15:43:00.936625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:02.753927 run osmo-stp_10.42.42.5(pid=18562): stderr: | [0;m[38;5;43m20221209154301273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154301273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154301273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154301274 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154301274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154301274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154301274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:02.891469 run osmo-stp_10.42.42.5(pid=18562): stdout: | (launched: 2022-12-09_15:43:00.936625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:03.022968 run osmo-stp_10.42.42.5(pid=18562): stderr: | [0;m[38;5;43m20221209154301273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154301273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154301273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154301274 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154301274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154301274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154301274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:03.178692 run patchelf(pid=18565): Terminating (SIGINT) 15:43:03.358911 run patchelf(pid=18565): Terminated: ok {rc=0} 15:43:03.488852 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18562): Process ended prematurely: osmo-stp_10.42.42.5(pid=18562) [trial-2361↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18562)] [trial-2361↪gprs:sysmo↪iperf3.py:8] 15:43:03.498781 tst iperf3.py:8: Test FAILED (7.7 sec) 15:43:03.527460 run osmo-hlr_10.42.42.2(pid=18559): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18559)] 15:43:03.577525 run osmo-hlr_10.42.42.2(pid=18559): stdout: | (launched: 2022-12-09_15:43:00.003055) 15:43:03.629440 run osmo-hlr_10.42.42.2(pid=18559): stderr: | [0;m[1;31m20221209154300177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154300177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154300177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154300177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154300177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154300177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154300192 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154300202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154300203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154300203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:03.681887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18554): Terminating (SIGTERM) 15:43:03.723883 run iperf3-srv_10.42.42.10(pid=18555): Terminating (SIGTERM) 15:43:03.765790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18558): Terminating (SIGTERM) 15:43:03.807858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18561): Terminating (SIGTERM) 15:43:03.849956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18564): Terminating (SIGTERM) 15:43:03.892167 --- ParallelTerminationStrategy: PID 18554 died... 15:43:03.912187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18554): Terminated: ok {rc=0} 15:43:03.959198 --- ParallelTerminationStrategy: PID 18555 died... 15:43:03.978668 run iperf3-srv_10.42.42.10(pid=18555): Terminated {rc=256} 15:43:04.025292 --- ParallelTerminationStrategy: PID 18558 died... 15:43:04.044650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18558): Terminated: ok {rc=0} 15:43:04.091696 --- ParallelTerminationStrategy: PID 18561 died... 15:43:04.111357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18561): Terminated: ok {rc=0} 15:43:04.158176 --- ParallelTerminationStrategy: PID 18564 died... 15:43:04.177916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18564): Terminated: ok {rc=0} 15:43:04.266268 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo iperf3m4.py ---------------------------------------------- 15:43:05.416277 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:05.427929 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:43:05.466916 tst iperf3m4.py: using LAC 22047 15:43:05.591615 tst iperf3m4.py: using RAC 117 15:43:05.716058 tst iperf3m4.py: using CellId 22047 15:43:05.838786 tst iperf3m4.py: using BVCI 22048 15:43:05.954989 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:05.965926 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:05.976619 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:05.987608 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:05.998484 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:06.009358 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:06.020378 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:06.031275 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:06.042369 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:43:06.161653 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:43:06.278742 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:43:06.393411 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:43:06.507176 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:43:06.708226 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:07.009259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18566): Launched 15:43:07.270621 run iperf3-srv_10.42.42.10(pid=18567): Launched 15:43:07.382337 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:43:07.582671 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:07.883089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18568): Launched 15:43:08.144120 run iperf3-srv_10.42.42.10(pid=18569): Launched 15:43:08.256479 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:43:08.457166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:08.758601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18570): Launched 15:43:09.019347 run iperf3-srv_10.42.42.10(pid=18571): Launched 15:43:09.130361 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:43:09.329615 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:09.629802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18572): Launched 15:43:09.905792 run iperf3-srv_10.42.42.10(pid=18573): Launched 15:43:10.017523 tst iperf3m4.py:8: start network... 15:43:10.218083 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:10.681640 run create_hlr_db(pid=18574): Launched 15:43:10.803813 bus /gobi_6: Setting Powered False 15:43:11.863869 run create_hlr_db(pid=18574): Terminated: ok {rc=0} 15:43:12.301687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18576): Launched 15:43:12.624462 run osmo-hlr_10.42.42.2(pid=18577): Launched 15:43:12.747929 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:13.298800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18579): Launched 15:43:13.619795 run osmo-stp_10.42.42.5(pid=18580): Launched 15:43:13.743273 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:43:14.298043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18582): Launched 15:43:14.422809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:43:14.694554 run patchelf(pid=18583): Launched 15:43:14.872711 run osmo-stp_10.42.42.5(pid=18580): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18580)] 15:43:15.009029 run osmo-stp_10.42.42.5(pid=18580): stdout: | (launched: 2022-12-09_15:43:13.560803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:15.146884 run osmo-stp_10.42.42.5(pid=18580): stderr: | [0;m[38;5;43m20221209154313751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154313752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154313752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154313752 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154313753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154313753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154313753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:15.284146 run osmo-stp_10.42.42.5(pid=18580): stdout: | (launched: 2022-12-09_15:43:13.560803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:15.415861 run osmo-stp_10.42.42.5(pid=18580): stderr: | [0;m[38;5;43m20221209154313751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154313752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154313752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154313752 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154313753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154313753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154313753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:15.571415 run patchelf(pid=18583): Terminating (SIGINT) 15:43:15.750974 run patchelf(pid=18583): Terminated: ok {rc=0} 15:43:15.888918 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18580): Process ended prematurely: osmo-stp_10.42.42.5(pid=18580) [trial-2361↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18580)] [trial-2361↪gprs:sysmo↪iperf3m4.py:8] 15:43:15.901453 tst iperf3m4.py:8: Test FAILED (10.5 sec) 15:43:15.935289 run osmo-hlr_10.42.42.2(pid=18577): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18577)] 15:43:15.986844 run osmo-hlr_10.42.42.2(pid=18577): stdout: | (launched: 2022-12-09_15:43:12.565267) 15:43:16.040140 run osmo-hlr_10.42.42.2(pid=18577): stderr: | [0;m[1;31m20221209154312764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154312764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154312764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154312764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154312764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154312764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154312776 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154312784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154312785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154312785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:16.094652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18566): Terminating (SIGTERM) 15:43:16.139116 run iperf3-srv_10.42.42.10(pid=18567): Terminating (SIGTERM) 15:43:16.185739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18568): Terminating (SIGTERM) 15:43:16.230492 run iperf3-srv_10.42.42.10(pid=18569): Terminating (SIGTERM) 15:43:16.277048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18570): Terminating (SIGTERM) 15:43:16.321638 run iperf3-srv_10.42.42.10(pid=18571): Terminating (SIGTERM) 15:43:16.368320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18572): Terminating (SIGTERM) 15:43:16.412844 run iperf3-srv_10.42.42.10(pid=18573): Terminating (SIGTERM) 15:43:16.459415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18576): Terminating (SIGTERM) 15:43:16.503546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18579): Terminating (SIGTERM) 15:43:16.547458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18582): Terminating (SIGTERM) 15:43:16.591517 --- ParallelTerminationStrategy: PID 18566 died... 15:43:16.611812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18566): Terminated: ok {rc=0} 15:43:16.661187 --- ParallelTerminationStrategy: PID 18567 died... 15:43:16.681654 run iperf3-srv_10.42.42.10(pid=18567): Terminated {rc=256} 15:43:16.730717 --- ParallelTerminationStrategy: PID 18568 died... 15:43:16.751110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18568): Terminated: ok {rc=0} 15:43:16.800144 --- ParallelTerminationStrategy: PID 18569 died... 15:43:16.820522 run iperf3-srv_10.42.42.10(pid=18569): Terminated {rc=256} 15:43:16.869729 --- ParallelTerminationStrategy: PID 18570 died... 15:43:16.890050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18570): Terminated: ok {rc=0} 15:43:16.939363 --- ParallelTerminationStrategy: PID 18571 died... 15:43:16.959639 run iperf3-srv_10.42.42.10(pid=18571): Terminated {rc=256} 15:43:17.008656 --- ParallelTerminationStrategy: PID 18572 died... 15:43:17.029105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18572): Terminated: ok {rc=0} 15:43:17.078073 --- ParallelTerminationStrategy: PID 18573 died... 15:43:17.098154 run iperf3-srv_10.42.42.10(pid=18573): Terminated {rc=256} 15:43:17.147084 --- ParallelTerminationStrategy: PID 18576 died... 15:43:17.167362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18576): Terminated: ok {rc=0} 15:43:17.214985 --- ParallelTerminationStrategy: PID 18579 died... 15:43:17.234374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18579): Terminated: ok {rc=0} 15:43:17.280632 --- ParallelTerminationStrategy: PID 18582 died... 15:43:17.300014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18582): Terminated: ok {rc=0} 15:43:17.388786 bus /gobi_4: Setting Powered False 15:43:18.488206 bus /gobi_4: Setting Powered False 15:43:19.603938 bus /gobi_1: Setting Powered False 15:43:20.699887 bus /gobi_1: Setting Powered False 15:43:21.814764 bus /gobi_0: Setting Powered False 15:43:22.913543 bus /gobi_0: Setting Powered False 15:43:24.027875 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo ping.py ---------------------------------------------- 15:43:25.132498 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:25.144019 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:43:25.185862 tst ping.py: using LAC 22048 15:43:25.312548 tst ping.py: using RAC 118 15:43:25.428622 tst ping.py: using CellId 22048 15:43:25.542434 tst ping.py: using BVCI 22049 15:43:25.649914 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:25.660541 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:25.671276 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:25.682418 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:25.693556 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:25.704488 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:25.715574 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:25.726456 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:43:25.840396 tst ping.py:19: start network... 15:43:26.038463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:26.496689 run create_hlr_db(pid=18585): Launched 15:43:26.615784 bus /gobi_6: Setting Powered False 15:43:27.675849 run create_hlr_db(pid=18585): Terminated: ok {rc=0} 15:43:28.107897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18587): Launched 15:43:28.406998 run osmo-hlr_10.42.42.2(pid=18588): Launched 15:43:28.516753 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:29.035608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18590): Launched 15:43:29.328006 run osmo-stp_10.42.42.5(pid=18591): Launched 15:43:29.437945 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:43:29.939566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18593): Launched 15:43:30.050718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:43:30.298311 run patchelf(pid=18594): Launched 15:43:30.461739 run osmo-stp_10.42.42.5(pid=18591): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18591)] 15:43:30.585856 run osmo-stp_10.42.42.5(pid=18591): stdout: | (launched: 2022-12-09_15:43:29.273034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:30.711848 run osmo-stp_10.42.42.5(pid=18591): stderr: | [0;m[38;5;43m20221209154329444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154329444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154329444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154329445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154329445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154329445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154329446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:30.848942 run osmo-stp_10.42.42.5(pid=18591): stdout: | (launched: 2022-12-09_15:43:29.273034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:30.989927 run osmo-stp_10.42.42.5(pid=18591): stderr: | [0;m[38;5;43m20221209154329444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154329444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154329444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154329445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154329445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154329445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154329446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:31.134857 run patchelf(pid=18594): Terminating (SIGINT) 15:43:31.301686 run patchelf(pid=18594): Terminated: ok {rc=0} 15:43:31.423026 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18591): Process ended prematurely: osmo-stp_10.42.42.5(pid=18591) [trial-2361↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18591)] [trial-2361↪gprs:sysmo↪ping.py:22] 15:43:31.432103 tst ping.py:22: Test FAILED (6.3 sec) 15:43:31.458946 run osmo-hlr_10.42.42.2(pid=18588): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18588)] 15:43:31.507146 run osmo-hlr_10.42.42.2(pid=18588): stdout: | (launched: 2022-12-09_15:43:28.351263) 15:43:31.557146 run osmo-hlr_10.42.42.2(pid=18588): stderr: | [0;m[1;31m20221209154328529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154328529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154328529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154328530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154328530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154328530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154328542 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154328550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154328550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154328551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:31.608190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18587): Terminating (SIGTERM) 15:43:31.649602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18590): Terminating (SIGTERM) 15:43:31.692165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18593): Terminating (SIGTERM) 15:43:31.734101 --- ParallelTerminationStrategy: PID 18587 died... 15:43:31.753914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18587): Terminated: ok {rc=0} 15:43:31.800435 --- ParallelTerminationStrategy: PID 18590 died... 15:43:31.819698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18590): Terminated: ok {rc=0} 15:43:31.864337 --- ParallelTerminationStrategy: PID 18593 died... 15:43:31.883118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18593): Terminated: ok {rc=0} 15:43:31.977272 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 15:43:33.066122 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:33.077580 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:43:33.118522 tst ping_idle_ping.py: using LAC 22049 15:43:33.242599 tst ping_idle_ping.py: using RAC 119 15:43:33.364014 tst ping_idle_ping.py: using CellId 22049 15:43:33.487900 tst ping_idle_ping.py: using BVCI 22050 15:43:33.602410 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:33.613422 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:33.624213 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:33.635779 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:33.647442 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:33.658807 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:33.670444 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:43:33.682050 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:43:33.805622 tst ping_idle_ping.py:24: start network... 15:43:34.003605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:34.457875 run create_hlr_db(pid=18595): Launched 15:43:34.578262 bus /gobi_6: Setting Powered False 15:43:35.636438 run create_hlr_db(pid=18595): Terminated: ok {rc=0} 15:43:36.046353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18597): Launched 15:43:36.340017 run osmo-hlr_10.42.42.2(pid=18598): Launched 15:43:36.451447 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:36.952608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18600): Launched 15:43:37.246599 run osmo-stp_10.42.42.5(pid=18601): Launched 15:43:37.357305 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:43:37.862799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18603): Launched 15:43:37.974806 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:43:38.223624 run patchelf(pid=18604): Launched 15:43:38.386154 run osmo-stp_10.42.42.5(pid=18601): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18601)] 15:43:38.510686 run osmo-stp_10.42.42.5(pid=18601): stdout: | (launched: 2022-12-09_15:43:37.191358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:38.636377 run osmo-stp_10.42.42.5(pid=18601): stderr: | [0;m[38;5;43m20221209154337361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154337361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154337362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154337362 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154337363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154337363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154337363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:38.762084 run osmo-stp_10.42.42.5(pid=18601): stdout: | (launched: 2022-12-09_15:43:37.191358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:38.882219 run osmo-stp_10.42.42.5(pid=18601): stderr: | [0;m[38;5;43m20221209154337361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154337361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154337362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154337362 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154337363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154337363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154337363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:39.024684 run patchelf(pid=18604): Terminating (SIGINT) 15:43:39.188549 run patchelf(pid=18604): Terminated: ok {rc=0} 15:43:39.307203 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18601): Process ended prematurely: osmo-stp_10.42.42.5(pid=18601) [trial-2361↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18601)] [trial-2361↪gprs:sysmo↪ping_idle_ping.py:27] 15:43:39.315646 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 15:43:39.341575 run osmo-hlr_10.42.42.2(pid=18598): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18598)] 15:43:39.388350 run osmo-hlr_10.42.42.2(pid=18598): stdout: | (launched: 2022-12-09_15:43:36.285618) 15:43:39.436666 run osmo-hlr_10.42.42.2(pid=18598): stderr: | [0;m[1;31m20221209154336461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154336461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154336461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154336461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154336461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154336461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154336476 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154336485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154336485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154336485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:39.485591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18597): Terminating (SIGTERM) 15:43:39.524412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18600): Terminating (SIGTERM) 15:43:39.563370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18603): Terminating (SIGTERM) 15:43:39.602632 --- ParallelTerminationStrategy: PID 18597 died... 15:43:39.621367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18597): Terminated: ok {rc=0} 15:43:39.664874 --- ParallelTerminationStrategy: PID 18600 died... 15:43:39.683666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18600): Terminated: ok {rc=0} 15:43:39.726875 --- ParallelTerminationStrategy: PID 18603 died... 15:43:39.745155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18603): Terminated: ok {rc=0} 15:43:39.826976 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 15:43:41.109023 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:43:41.114008 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 15:43:41.134304 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 15:43:41.171932 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 15:43:41.263713 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 15:43:41.284113 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 15:43:41.321767 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 15:43:41.915297 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 15:43:41.969746 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:41.981061 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:43:42.018522 tst cs_paging_gprs_active.py: using LAC 22050 15:43:42.145173 tst cs_paging_gprs_active.py: using RAC 120 15:43:42.270582 tst cs_paging_gprs_active.py: using CellId 22050 15:43:42.397901 tst cs_paging_gprs_active.py: using BVCI 22051 15:43:42.515018 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:42.526295 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:42.537211 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:42.548575 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:42.559999 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:42.571089 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:42.582484 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:42.593531 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:42.605079 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:43:42.720854 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:43:42.840491 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:43:43.059168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:43.383805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18608): Launched 15:43:43.665660 run iperf3-srv_10.42.42.10(pid=18609): Launched 15:43:43.786352 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:43:44.004109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:44.327874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18610): Launched 15:43:44.611955 run iperf3-srv_10.42.42.10(pid=18611): Launched 15:43:44.733196 tst cs_paging_gprs_active.py:38: start network... 15:43:44.951110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:45.451287 run create_hlr_db(pid=18612): Launched 15:43:45.573429 bus /gobi_6: Setting Powered False 15:43:46.635816 run create_hlr_db(pid=18612): Terminated: ok {rc=0} 15:43:47.103644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18614): Launched 15:43:47.430910 run osmo-hlr_10.42.42.2(pid=18615): Launched 15:43:47.555139 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:48.114494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18617): Launched 15:43:48.438438 run osmo-stp_10.42.42.5(pid=18618): Launched 15:43:48.561374 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:43:49.117745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18620): Launched 15:43:49.242721 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:43:49.515853 run patchelf(pid=18621): Launched 15:43:49.694989 run osmo-stp_10.42.42.5(pid=18618): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18618)] 15:43:49.831798 run osmo-stp_10.42.42.5(pid=18618): stdout: | (launched: 2022-12-09_15:43:48.378502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:49.969932 run osmo-stp_10.42.42.5(pid=18618): stderr: | [0;m[38;5;43m20221209154348570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154348570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154348570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154348571 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154348571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154348571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154348571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:50.107883 run osmo-stp_10.42.42.5(pid=18618): stdout: | (launched: 2022-12-09_15:43:48.378502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:50.239619 run osmo-stp_10.42.42.5(pid=18618): stderr: | [0;m[38;5;43m20221209154348570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154348570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154348570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154348571 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154348571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154348571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154348571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:50.396105 run patchelf(pid=18621): Terminating (SIGINT) 15:43:50.577084 run patchelf(pid=18621): Terminated: ok {rc=0} 15:43:50.707697 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18618): Process ended prematurely: osmo-stp_10.42.42.5(pid=18618) [trial-2361↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18618)] [trial-2361↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 15:43:50.717921 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 15:43:50.746587 run osmo-hlr_10.42.42.2(pid=18615): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18615)] 15:43:50.797185 run osmo-hlr_10.42.42.2(pid=18615): stdout: | (launched: 2022-12-09_15:43:47.371102) 15:43:50.849071 run osmo-hlr_10.42.42.2(pid=18615): stderr: | [0;m[1;31m20221209154347570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154347570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154347570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154347570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154347570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154347570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154347583 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154347592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154347593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154347593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:50.901465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18608): Terminating (SIGTERM) 15:43:50.943657 run iperf3-srv_10.42.42.10(pid=18609): Terminating (SIGTERM) 15:43:50.985668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18610): Terminating (SIGTERM) 15:43:51.027875 run iperf3-srv_10.42.42.10(pid=18611): Terminating (SIGTERM) 15:43:51.069850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18614): Terminating (SIGTERM) 15:43:51.112061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18617): Terminating (SIGTERM) 15:43:51.154094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18620): Terminating (SIGTERM) 15:43:51.196409 --- ParallelTerminationStrategy: PID 18608 died... 15:43:51.216400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18608): Terminated: ok {rc=0} 15:43:51.263156 --- ParallelTerminationStrategy: PID 18609 died... 15:43:51.282588 run iperf3-srv_10.42.42.10(pid=18609): Terminated {rc=256} 15:43:51.328930 --- ParallelTerminationStrategy: PID 18610 died... 15:43:51.349032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18610): Terminated: ok {rc=0} 15:43:51.395779 --- ParallelTerminationStrategy: PID 18611 died... 15:43:51.415242 run iperf3-srv_10.42.42.10(pid=18611): Terminated {rc=256} 15:43:51.461527 --- ParallelTerminationStrategy: PID 18614 died... 15:43:51.480936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18614): Terminated: ok {rc=0} 15:43:51.527323 --- ParallelTerminationStrategy: PID 18617 died... 15:43:51.546824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18617): Terminated: ok {rc=0} 15:43:51.593210 --- ParallelTerminationStrategy: PID 18620 died... 15:43:51.612813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18620): Terminated: ok {rc=0} 15:43:51.699228 bus /gobi_0: Setting Powered False 15:43:52.797484 bus /gobi_0: Setting Powered False 15:43:53.915005 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 15:43:55.059613 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:55.070877 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:43:55.113498 tst iperf3.py: using LAC 22051 15:43:55.230475 tst iperf3.py: using RAC 121 15:43:55.346817 tst iperf3.py: using CellId 22051 15:43:55.462296 tst iperf3.py: using BVCI 22052 15:43:55.571395 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:55.582109 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:55.592618 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:55.603125 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:55.613682 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:55.624063 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:55.634677 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:55.645052 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:43:55.655577 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:43:55.776477 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:43:55.995134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:56.318775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18622): Launched 15:43:56.600483 run iperf3-srv_10.42.42.10(pid=18623): Launched 15:43:56.720868 tst iperf3.py:8: start network... 15:43:56.938399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:57.435595 run create_hlr_db(pid=18624): Launched 15:43:57.557454 bus /gobi_6: Setting Powered False 15:43:58.620908 run create_hlr_db(pid=18624): Terminated: ok {rc=0} 15:43:59.069075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18627): Launched 15:43:59.389946 run osmo-hlr_10.42.42.2(pid=18628): Launched 15:43:59.513088 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:00.067237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18630): Launched 15:44:00.389359 run osmo-stp_10.42.42.5(pid=18631): Launched 15:44:00.511880 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:01.089831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18633): Launched 15:44:01.219290 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:01.503549 run patchelf(pid=18634): Launched 15:44:01.700726 run osmo-stp_10.42.42.5(pid=18631): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18631)] 15:44:01.841669 run osmo-stp_10.42.42.5(pid=18631): stdout: | (launched: 2022-12-09_15:44:00.329744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:01.983312 run osmo-stp_10.42.42.5(pid=18631): stderr: | [0;m[38;5;43m20221209154400524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154400524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154400524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154400525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154400525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154400525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154400525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:02.124808 run osmo-stp_10.42.42.5(pid=18631): stdout: | (launched: 2022-12-09_15:44:00.329744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:02.257715 run osmo-stp_10.42.42.5(pid=18631): stderr: | [0;m[38;5;43m20221209154400524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154400524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154400524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154400525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154400525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154400525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154400525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:02.414225 run patchelf(pid=18634): Terminating (SIGINT) 15:44:02.594483 run patchelf(pid=18634): Terminated: ok {rc=0} 15:44:02.725165 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18631): Process ended prematurely: osmo-stp_10.42.42.5(pid=18631) [trial-2361↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18631)] [trial-2361↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 15:44:02.735134 tst iperf3.py:8: Test FAILED (7.7 sec) 15:44:02.763593 run osmo-hlr_10.42.42.2(pid=18628): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18628)] 15:44:02.813311 run osmo-hlr_10.42.42.2(pid=18628): stdout: | (launched: 2022-12-09_15:43:59.330481) 15:44:02.864491 run osmo-hlr_10.42.42.2(pid=18628): stderr: | [0;m[1;31m20221209154359528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154359528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154359528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154359528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154359528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154359528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154359545 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154359555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154359555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154359555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:02.916229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18622): Terminating (SIGTERM) 15:44:02.957638 run iperf3-srv_10.42.42.10(pid=18623): Terminating (SIGTERM) 15:44:02.999431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18627): Terminating (SIGTERM) 15:44:03.040689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18630): Terminating (SIGTERM) 15:44:03.081877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18633): Terminating (SIGTERM) 15:44:03.123320 --- ParallelTerminationStrategy: PID 18622 died... 15:44:03.143012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18622): Terminated: ok {rc=0} 15:44:03.189931 --- ParallelTerminationStrategy: PID 18623 died... 15:44:03.209613 run iperf3-srv_10.42.42.10(pid=18623): Terminated {rc=256} 15:44:03.255434 --- ParallelTerminationStrategy: PID 18627 died... 15:44:03.274600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18627): Terminated: ok {rc=0} 15:44:03.320363 --- ParallelTerminationStrategy: PID 18630 died... 15:44:03.339629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18630): Terminated: ok {rc=0} 15:44:03.386376 --- ParallelTerminationStrategy: PID 18633 died... 15:44:03.405789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18633): Terminated: ok {rc=0} 15:44:03.493597 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 15:44:04.643142 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:04.654850 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:44:04.693276 tst iperf3m4.py: using LAC 22052 15:44:04.818575 tst iperf3m4.py: using RAC 122 15:44:04.943801 tst iperf3m4.py: using CellId 22052 15:44:05.068630 tst iperf3m4.py: using BVCI 22053 15:44:05.184479 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:05.195732 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:05.206700 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:05.217898 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:05.229095 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:05.240135 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:05.251428 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:05.262605 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:05.273923 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:05.395318 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:05.511820 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:05.630812 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:05.749478 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:44:05.967227 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:06.293404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18635): Launched 15:44:06.574262 run iperf3-srv_10.42.42.10(pid=18636): Launched 15:44:06.694731 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:44:06.912551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:07.236619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18637): Launched 15:44:07.518163 run iperf3-srv_10.42.42.10(pid=18638): Launched 15:44:07.640042 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:44:07.857476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:08.182164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18639): Launched 15:44:08.464197 run iperf3-srv_10.42.42.10(pid=18640): Launched 15:44:08.584614 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:44:08.802440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:09.126376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18641): Launched 15:44:09.407329 run iperf3-srv_10.42.42.10(pid=18642): Launched 15:44:09.527446 tst iperf3m4.py:8: start network... 15:44:09.744237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:10.242289 run create_hlr_db(pid=18643): Launched 15:44:10.363504 bus /gobi_6: Setting Powered False 15:44:11.427243 run create_hlr_db(pid=18643): Terminated: ok {rc=0} 15:44:11.856458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18645): Launched 15:44:12.157255 run osmo-hlr_10.42.42.2(pid=18646): Launched 15:44:12.270327 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:12.785724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18648): Launched 15:44:13.085985 run osmo-stp_10.42.42.5(pid=18649): Launched 15:44:13.198908 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:13.712589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18651): Launched 15:44:13.826572 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:14.078569 run patchelf(pid=18652): Launched 15:44:14.244215 run osmo-stp_10.42.42.5(pid=18649): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18649)] 15:44:14.370330 run osmo-stp_10.42.42.5(pid=18649): stdout: | (launched: 2022-12-09_15:44:13.029817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:14.498079 run osmo-stp_10.42.42.5(pid=18649): stderr: | [0;m[38;5;43m20221209154413203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154413203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154413204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154413204 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154413205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154413205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154413205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:14.626377 run osmo-stp_10.42.42.5(pid=18649): stdout: | (launched: 2022-12-09_15:44:13.029817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:14.748752 run osmo-stp_10.42.42.5(pid=18649): stderr: | [0;m[38;5;43m20221209154413203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154413203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154413204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154413204 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154413205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154413205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154413205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:14.893183 run patchelf(pid=18652): Terminating (SIGINT) 15:44:15.059764 run patchelf(pid=18652): Terminated: ok {rc=0} 15:44:15.180462 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18649): Process ended prematurely: osmo-stp_10.42.42.5(pid=18649) [trial-2361↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18649)] [trial-2361↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 15:44:15.189644 tst iperf3m4.py:8: Test FAILED (10.6 sec) 15:44:15.216868 run osmo-hlr_10.42.42.2(pid=18646): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18646)] 15:44:15.264118 run osmo-hlr_10.42.42.2(pid=18646): stdout: | (launched: 2022-12-09_15:44:12.101424) 15:44:15.312790 run osmo-hlr_10.42.42.2(pid=18646): stderr: | [0;m[1;31m20221209154412280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154412280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154412280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154412280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154412280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154412280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154412293 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154412302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154412302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154412302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:15.361984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18635): Terminating (SIGTERM) 15:44:15.401270 run iperf3-srv_10.42.42.10(pid=18636): Terminating (SIGTERM) 15:44:15.440326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18637): Terminating (SIGTERM) 15:44:15.479522 run iperf3-srv_10.42.42.10(pid=18638): Terminating (SIGTERM) 15:44:15.518705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18639): Terminating (SIGTERM) 15:44:15.558505 run iperf3-srv_10.42.42.10(pid=18640): Terminating (SIGTERM) 15:44:15.598009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18641): Terminating (SIGTERM) 15:44:15.637242 run iperf3-srv_10.42.42.10(pid=18642): Terminating (SIGTERM) 15:44:15.676267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18645): Terminating (SIGTERM) 15:44:15.715478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18648): Terminating (SIGTERM) 15:44:15.754963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18651): Terminating (SIGTERM) 15:44:15.794337 --- ParallelTerminationStrategy: PID 18635 died... 15:44:15.813221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18635): Terminated: ok {rc=0} 15:44:15.863007 --- ParallelTerminationStrategy: PID 18636 died... 15:44:15.884924 run iperf3-srv_10.42.42.10(pid=18636): Terminated {rc=256} 15:44:15.934316 --- ParallelTerminationStrategy: PID 18637 died... 15:44:15.954443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18637): Terminated: ok {rc=0} 15:44:16.004805 --- ParallelTerminationStrategy: PID 18638 died... 15:44:16.025237 run iperf3-srv_10.42.42.10(pid=18638): Terminated {rc=256} 15:44:16.074210 --- ParallelTerminationStrategy: PID 18639 died... 15:44:16.095782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18639): Terminated: ok {rc=0} 15:44:16.149778 --- ParallelTerminationStrategy: PID 18640 died... 15:44:16.172902 run iperf3-srv_10.42.42.10(pid=18640): Terminated {rc=256} 15:44:16.226738 --- ParallelTerminationStrategy: PID 18641 died... 15:44:16.248304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18641): Terminated: ok {rc=0} 15:44:16.302498 --- ParallelTerminationStrategy: PID 18642 died... 15:44:16.325645 run iperf3-srv_10.42.42.10(pid=18642): Terminated {rc=256} 15:44:16.380137 --- ParallelTerminationStrategy: PID 18645 died... 15:44:16.403213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18645): Terminated: ok {rc=0} 15:44:16.456089 --- ParallelTerminationStrategy: PID 18648 died... 15:44:16.480057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18648): Terminated: ok {rc=0} 15:44:16.532444 --- ParallelTerminationStrategy: PID 18651 died... 15:44:16.553148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18651): Terminated: ok {rc=0} 15:44:16.651460 bus /gobi_4: Setting Powered False 15:44:17.745482 bus /gobi_4: Setting Powered False 15:44:18.859034 bus /gobi_1: Setting Powered False 15:44:19.957231 bus /gobi_1: Setting Powered False 15:44:21.069452 bus /gobi_0: Setting Powered False 15:44:22.165640 bus /gobi_0: Setting Powered False 15:44:23.281342 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 15:44:24.383542 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:24.395445 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:44:24.434201 tst ping.py: using LAC 22053 15:44:24.557958 tst ping.py: using RAC 123 15:44:24.681647 tst ping.py: using CellId 22053 15:44:24.805835 tst ping.py: using BVCI 22054 15:44:24.921187 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:24.932220 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:24.943375 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:24.954621 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:24.965762 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:24.976846 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:24.988184 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:24.999337 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:25.115996 tst ping.py:19: start network... 15:44:25.312886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:25.766581 run create_hlr_db(pid=18653): Launched 15:44:25.886456 bus /gobi_6: Setting Powered False 15:44:26.944895 run create_hlr_db(pid=18653): Terminated: ok {rc=0} 15:44:27.375645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18655): Launched 15:44:27.672857 run osmo-hlr_10.42.42.2(pid=18656): Launched 15:44:27.782786 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:28.297824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18658): Launched 15:44:28.590385 run osmo-stp_10.42.42.5(pid=18659): Launched 15:44:28.699382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:29.201604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18661): Launched 15:44:29.312378 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:29.559566 run patchelf(pid=18662): Launched 15:44:29.721738 run osmo-stp_10.42.42.5(pid=18659): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18659)] 15:44:29.845533 run osmo-stp_10.42.42.5(pid=18659): stdout: | (launched: 2022-12-09_15:44:28.535354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:29.970948 run osmo-stp_10.42.42.5(pid=18659): stderr: | [0;m[38;5;43m20221209154428704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154428704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154428705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154428705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154428707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154428707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154428708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:30.096598 run osmo-stp_10.42.42.5(pid=18659): stdout: | (launched: 2022-12-09_15:44:28.535354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:30.216149 run osmo-stp_10.42.42.5(pid=18659): stderr: | [0;m[38;5;43m20221209154428704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154428704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154428705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154428705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154428707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154428707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154428708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:30.358306 run patchelf(pid=18662): Terminating (SIGINT) 15:44:30.522606 run patchelf(pid=18662): Terminated: ok {rc=0} 15:44:30.640638 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18659): Process ended prematurely: osmo-stp_10.42.42.5(pid=18659) [trial-2361↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18659)] [trial-2361↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 15:44:30.649357 tst ping.py:22: Test FAILED (6.3 sec) 15:44:30.675692 run osmo-hlr_10.42.42.2(pid=18656): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18656)] 15:44:30.722802 run osmo-hlr_10.42.42.2(pid=18656): stdout: | (launched: 2022-12-09_15:44:27.618190) 15:44:30.771715 run osmo-hlr_10.42.42.2(pid=18656): stderr: | [0;m[1;31m20221209154427793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154427794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154427794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154427794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154427794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154427794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154427806 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154427814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154427815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154427815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:30.821145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18655): Terminating (SIGTERM) 15:44:30.866096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18658): Terminating (SIGTERM) 15:44:30.908427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18661): Terminating (SIGTERM) 15:44:30.964352 --- ParallelTerminationStrategy: PID 18655 died... 15:44:30.990381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18655): Terminated: ok {rc=0} 15:44:31.035283 --- ParallelTerminationStrategy: PID 18658 died... 15:44:31.054432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18658): Terminated: ok {rc=0} 15:44:31.098921 --- ParallelTerminationStrategy: PID 18661 died... 15:44:31.118099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18661): Terminated: ok {rc=0} 15:44:31.206912 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 15:44:32.301470 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:32.312536 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:44:32.349995 tst ping_idle_ping.py: using LAC 22054 15:44:32.470185 tst ping_idle_ping.py: using RAC 124 15:44:32.586829 tst ping_idle_ping.py: using CellId 22054 15:44:32.700433 tst ping_idle_ping.py: using BVCI 22055 15:44:32.806058 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:32.816785 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:32.827415 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:32.838012 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:32.848768 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:32.859388 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:32.870005 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:32.880454 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:33.003427 tst ping_idle_ping.py:24: start network... 15:44:33.218384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:33.707835 run create_hlr_db(pid=18663): Launched 15:44:33.828115 bus /gobi_6: Setting Powered False 15:44:34.891263 run create_hlr_db(pid=18663): Terminated: ok {rc=0} 15:44:35.314204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18665): Launched 15:44:35.609239 run osmo-hlr_10.42.42.2(pid=18666): Launched 15:44:35.720673 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:36.227167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18668): Launched 15:44:36.520373 run osmo-stp_10.42.42.5(pid=18669): Launched 15:44:36.632167 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:37.155164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18671): Launched 15:44:37.266601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:37.515750 run patchelf(pid=18672): Launched 15:44:37.678884 run osmo-stp_10.42.42.5(pid=18669): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18669)] 15:44:37.803221 run osmo-stp_10.42.42.5(pid=18669): stdout: | (launched: 2022-12-09_15:44:36.465469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:37.929338 run osmo-stp_10.42.42.5(pid=18669): stderr: | [0;m[38;5;43m20221209154436636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154436636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154436636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154436637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154436637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154436637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154436637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:38.055803 run osmo-stp_10.42.42.5(pid=18669): stdout: | (launched: 2022-12-09_15:44:36.465469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:38.176029 run osmo-stp_10.42.42.5(pid=18669): stderr: | [0;m[38;5;43m20221209154436636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154436636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154436636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154436637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154436637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154436637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154436637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:38.318385 run patchelf(pid=18672): Terminating (SIGINT) 15:44:38.482634 run patchelf(pid=18672): Terminated: ok {rc=0} 15:44:38.600895 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18669): Process ended prematurely: osmo-stp_10.42.42.5(pid=18669) [trial-2361↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18669)] [trial-2361↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 15:44:38.609697 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 15:44:38.635624 run osmo-hlr_10.42.42.2(pid=18666): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18666)] 15:44:38.682114 run osmo-hlr_10.42.42.2(pid=18666): stdout: | (launched: 2022-12-09_15:44:35.554412) 15:44:38.730955 run osmo-hlr_10.42.42.2(pid=18666): stderr: | [0;m[1;31m20221209154435730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154435731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154435731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154435731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154435731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154435731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154435743 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154435752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154435752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154435752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:38.779830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18665): Terminating (SIGTERM) 15:44:38.818970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18668): Terminating (SIGTERM) 15:44:38.857951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18671): Terminating (SIGTERM) 15:44:38.897498 --- ParallelTerminationStrategy: PID 18665 died... 15:44:38.916528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18665): Terminated: ok {rc=0} 15:44:38.960109 --- ParallelTerminationStrategy: PID 18668 died... 15:44:38.978337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18668): Terminated: ok {rc=0} 15:44:39.021135 --- ParallelTerminationStrategy: PID 18671 died... 15:44:39.039253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18671): Terminated: ok {rc=0} 15:44:39.120385 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 15:44:40.406963 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:44:40.413481 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 15:44:40.435057 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 15:44:40.474793 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 15:44:40.565909 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 15:44:40.587627 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 15:44:40.627576 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 15:44:41.218723 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 15:44:41.271462 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:41.282860 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:44:41.340723 tst cs_paging_gprs_active.py: using LAC 22055 15:44:41.459598 tst cs_paging_gprs_active.py: using RAC 125 15:44:41.576736 tst cs_paging_gprs_active.py: using CellId 22055 15:44:41.703093 tst cs_paging_gprs_active.py: using BVCI 22056 15:44:41.821071 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:41.832582 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:41.843880 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:41.855456 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:41.866947 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:41.878522 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:41.890354 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:41.902177 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:41.913628 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:44:42.030281 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:44:42.145846 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:44:42.346510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:42.646955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18676): Launched 15:44:42.908714 run iperf3-srv_10.42.42.10(pid=18677): Launched 15:44:43.021159 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:44:43.221295 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:43.522294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18678): Launched 15:44:43.782810 run iperf3-srv_10.42.42.10(pid=18679): Launched 15:44:43.894712 tst cs_paging_gprs_active.py:38: start network... 15:44:44.094351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:44.556182 run create_hlr_db(pid=18680): Launched 15:44:44.679196 bus /gobi_6: Setting Powered False 15:44:45.738306 run create_hlr_db(pid=18680): Terminated: ok {rc=0} 15:44:46.197176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18682): Launched 15:44:46.523279 run osmo-hlr_10.42.42.2(pid=18683): Launched 15:44:46.735677 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:47.508720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18685): Launched 15:44:47.807775 run osmo-stp_10.42.42.5(pid=18686): Launched 15:44:47.921263 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:48.435446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18688): Launched 15:44:48.549938 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:48.803456 run patchelf(pid=18689): Launched 15:44:48.969917 run osmo-stp_10.42.42.5(pid=18686): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18686)] 15:44:49.097476 run osmo-stp_10.42.42.5(pid=18686): stdout: | (launched: 2022-12-09_15:44:47.752301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:49.226323 run osmo-stp_10.42.42.5(pid=18686): stderr: | [0;m[38;5;43m20221209154447924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154447924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154447925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154447925 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154447925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154447926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154447926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:49.354522 run osmo-stp_10.42.42.5(pid=18686): stdout: | (launched: 2022-12-09_15:44:47.752301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:49.476642 run osmo-stp_10.42.42.5(pid=18686): stderr: | [0;m[38;5;43m20221209154447924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154447924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154447925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154447925 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154447925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154447926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154447926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:49.621862 run patchelf(pid=18689): Terminating (SIGINT) 15:44:49.789928 run patchelf(pid=18689): Terminated: ok {rc=0} 15:44:49.911063 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18686): Process ended prematurely: osmo-stp_10.42.42.5(pid=18686) [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18686)] [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 15:44:49.920106 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 15:44:49.946766 run osmo-hlr_10.42.42.2(pid=18683): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18683)] 15:44:49.993524 run osmo-hlr_10.42.42.2(pid=18683): stdout: | (launched: 2022-12-09_15:44:46.453857) 15:44:50.041924 run osmo-hlr_10.42.42.2(pid=18683): stderr: | [0;m[1;31m20221209154446811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154446811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154446811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154446811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154446814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154446814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154446839 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154446856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154446856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154446856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:50.090959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18676): Terminating (SIGTERM) 15:44:50.129989 run iperf3-srv_10.42.42.10(pid=18677): Terminating (SIGTERM) 15:44:50.168904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18678): Terminating (SIGTERM) 15:44:50.207762 run iperf3-srv_10.42.42.10(pid=18679): Terminating (SIGTERM) 15:44:50.246731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18682): Terminating (SIGTERM) 15:44:50.285698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18685): Terminating (SIGTERM) 15:44:50.324762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18688): Terminating (SIGTERM) 15:44:50.363959 --- ParallelTerminationStrategy: PID 18676 died... 15:44:50.382693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18676): Terminated: ok {rc=0} 15:44:50.426342 --- ParallelTerminationStrategy: PID 18677 died... 15:44:50.444634 run iperf3-srv_10.42.42.10(pid=18677): Terminated {rc=256} 15:44:50.487771 --- ParallelTerminationStrategy: PID 18678 died... 15:44:50.506188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18678): Terminated: ok {rc=0} 15:44:50.549249 --- ParallelTerminationStrategy: PID 18679 died... 15:44:50.567533 run iperf3-srv_10.42.42.10(pid=18679): Terminated {rc=256} 15:44:50.611313 --- ParallelTerminationStrategy: PID 18682 died... 15:44:50.629778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18682): Terminated: ok {rc=0} 15:44:50.672837 --- ParallelTerminationStrategy: PID 18685 died... 15:44:50.691630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18685): Terminated: ok {rc=0} 15:44:50.734678 --- ParallelTerminationStrategy: PID 18688 died... 15:44:50.752929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18688): Terminated: ok {rc=0} 15:44:50.837215 bus /gobi_0: Setting Powered False 15:44:51.936766 bus /gobi_0: Setting Powered False 15:44:53.052755 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 15:44:54.196716 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:54.208220 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:44:54.267098 tst iperf3.py: using LAC 22056 15:44:54.385980 tst iperf3.py: using RAC 126 15:44:54.504648 tst iperf3.py: using CellId 22056 15:44:54.621397 tst iperf3.py: using BVCI 22057 15:44:54.729775 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:54.740609 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:54.751321 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:54.761983 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:54.772467 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:54.783141 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:54.793901 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:54.804358 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:44:54.815105 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:44:54.932604 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:44:55.151235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:55.476193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18690): Launched 15:44:55.757929 run iperf3-srv_10.42.42.10(pid=18691): Launched 15:44:55.877982 tst iperf3.py:8: start network... 15:44:56.095922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:56.594630 run create_hlr_db(pid=18692): Launched 15:44:56.717642 bus /gobi_6: Setting Powered False 15:44:57.780915 run create_hlr_db(pid=18692): Terminated: ok {rc=0} 15:44:58.211320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18694): Launched 15:44:58.511816 run osmo-hlr_10.42.42.2(pid=18695): Launched 15:44:58.625899 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:59.146512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18697): Launched 15:44:59.445959 run osmo-stp_10.42.42.5(pid=18698): Launched 15:44:59.559588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:00.071678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18700): Launched 15:45:00.186387 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:00.439633 run patchelf(pid=18701): Launched 15:45:00.606181 run osmo-stp_10.42.42.5(pid=18698): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18698)] 15:45:00.732678 run osmo-stp_10.42.42.5(pid=18698): stdout: | (launched: 2022-12-09_15:44:59.390150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:00.862295 run osmo-stp_10.42.42.5(pid=18698): stderr: | [0;m[38;5;43m20221209154459561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154459561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154459562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154459562 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154459563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154459563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154459563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:00.998404 run osmo-stp_10.42.42.5(pid=18698): stdout: | (launched: 2022-12-09_15:44:59.390150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:01.123407 run osmo-stp_10.42.42.5(pid=18698): stderr: | [0;m[38;5;43m20221209154459561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154459561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154459562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154459562 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154459563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154459563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154459563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:01.271872 run patchelf(pid=18701): Terminating (SIGINT) 15:45:01.442555 run patchelf(pid=18701): Terminated: ok {rc=0} 15:45:01.566011 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18698): Process ended prematurely: osmo-stp_10.42.42.5(pid=18698) [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18698)] [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 15:45:01.575766 tst iperf3.py:8: Test FAILED (7.4 sec) 15:45:01.603872 run osmo-hlr_10.42.42.2(pid=18695): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18695)] 15:45:01.653064 run osmo-hlr_10.42.42.2(pid=18695): stdout: | (launched: 2022-12-09_15:44:58.455805) 15:45:01.703014 run osmo-hlr_10.42.42.2(pid=18695): stderr: | [0;m[1;31m20221209154458633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154458633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154458634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154458634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154458634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154458634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154458646 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154458655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154458655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154458655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:01.753649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18690): Terminating (SIGTERM) 15:45:01.794805 run iperf3-srv_10.42.42.10(pid=18691): Terminating (SIGTERM) 15:45:01.838596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18694): Terminating (SIGTERM) 15:45:01.892271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18697): Terminating (SIGTERM) 15:45:01.934402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18700): Terminating (SIGTERM) 15:45:01.982513 --- ParallelTerminationStrategy: PID 18690 died... 15:45:02.005930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18690): Terminated: ok {rc=0} 15:45:02.062238 --- ParallelTerminationStrategy: PID 18691 died... 15:45:02.081303 run iperf3-srv_10.42.42.10(pid=18691): Terminated {rc=256} 15:45:02.126593 --- ParallelTerminationStrategy: PID 18694 died... 15:45:02.145585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18694): Terminated: ok {rc=0} 15:45:02.191089 --- ParallelTerminationStrategy: PID 18697 died... 15:45:02.210040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18697): Terminated: ok {rc=0} 15:45:02.255078 --- ParallelTerminationStrategy: PID 18700 died... 15:45:02.274032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18700): Terminated: ok {rc=0} 15:45:02.358634 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 15:45:03.503366 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:03.514781 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:45:03.573059 tst iperf3m4.py: using LAC 22057 15:45:03.690533 tst iperf3m4.py: using RAC 127 15:45:03.808630 tst iperf3m4.py: using CellId 22057 15:45:03.924383 tst iperf3m4.py: using BVCI 22058 15:45:04.031731 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:04.042629 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:04.053186 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:04.063631 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:04.074154 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:04.084687 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:04.095435 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:04.106025 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:04.116698 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:04.235564 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:04.354255 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:04.474470 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:04.594714 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:45:04.813025 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:05.141783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18705): Launched 15:45:05.430771 run iperf3-srv_10.42.42.10(pid=18706): Launched 15:45:05.553389 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:45:05.771511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:06.096421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18707): Launched 15:45:06.377677 run iperf3-srv_10.42.42.10(pid=18708): Launched 15:45:06.497954 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:45:06.714783 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:07.038389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18709): Launched 15:45:07.319851 run iperf3-srv_10.42.42.10(pid=18710): Launched 15:45:07.440631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:45:07.658429 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:07.983010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18711): Launched 15:45:08.266959 run iperf3-srv_10.42.42.10(pid=18712): Launched 15:45:08.387019 tst iperf3m4.py:8: start network... 15:45:08.605509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:09.103311 run create_hlr_db(pid=18713): Launched 15:45:09.225836 bus /gobi_6: Setting Powered False 15:45:10.289158 run create_hlr_db(pid=18713): Terminated: ok {rc=0} 15:45:10.718217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18715): Launched 15:45:11.017834 run osmo-hlr_10.42.42.2(pid=18716): Launched 15:45:11.130587 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:11.646601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18718): Launched 15:45:11.945743 run osmo-stp_10.42.42.5(pid=18719): Launched 15:45:12.057858 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:12.571211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18721): Launched 15:45:12.685136 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:12.938461 run patchelf(pid=18722): Launched 15:45:13.103704 run osmo-stp_10.42.42.5(pid=18719): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18719)] 15:45:13.231625 run osmo-stp_10.42.42.5(pid=18719): stdout: | (launched: 2022-12-09_15:45:11.889523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:13.360091 run osmo-stp_10.42.42.5(pid=18719): stderr: | [0;m[38;5;43m20221209154512062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154512062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154512062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154512063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154512063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154512063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154512063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:13.488454 run osmo-stp_10.42.42.5(pid=18719): stdout: | (launched: 2022-12-09_15:45:11.889523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:13.621201 run osmo-stp_10.42.42.5(pid=18719): stderr: | [0;m[38;5;43m20221209154512062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154512062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154512062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154512063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154512063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154512063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154512063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:13.777704 run patchelf(pid=18722): Terminating (SIGINT) 15:45:13.957868 run patchelf(pid=18722): Terminated: ok {rc=0} 15:45:14.087917 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18719): Process ended prematurely: osmo-stp_10.42.42.5(pid=18719) [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18719)] [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 15:45:14.098007 tst iperf3m4.py:8: Test FAILED (10.6 sec) 15:45:14.126982 run osmo-hlr_10.42.42.2(pid=18716): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18716)] 15:45:14.176447 run osmo-hlr_10.42.42.2(pid=18716): stdout: | (launched: 2022-12-09_15:45:10.962139) 15:45:14.227740 run osmo-hlr_10.42.42.2(pid=18716): stderr: | [0;m[1;31m20221209154511139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154511139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154511139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154511139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154511139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154511139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154511151 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154511162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154511162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154511162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:14.279211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18705): Terminating (SIGTERM) 15:45:14.320542 run iperf3-srv_10.42.42.10(pid=18706): Terminating (SIGTERM) 15:45:14.362475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18707): Terminating (SIGTERM) 15:45:14.404307 run iperf3-srv_10.42.42.10(pid=18708): Terminating (SIGTERM) 15:45:14.446399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18709): Terminating (SIGTERM) 15:45:14.488292 run iperf3-srv_10.42.42.10(pid=18710): Terminating (SIGTERM) 15:45:14.529972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18711): Terminating (SIGTERM) 15:45:14.571596 run iperf3-srv_10.42.42.10(pid=18712): Terminating (SIGTERM) 15:45:14.613137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18715): Terminating (SIGTERM) 15:45:14.654816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18718): Terminating (SIGTERM) 15:45:14.696392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18721): Terminating (SIGTERM) 15:45:14.738285 --- ParallelTerminationStrategy: PID 18705 died... 15:45:14.758199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18705): Terminated: ok {rc=0} 15:45:14.804550 --- ParallelTerminationStrategy: PID 18706 died... 15:45:14.823798 run iperf3-srv_10.42.42.10(pid=18706): Terminated {rc=256} 15:45:14.870087 --- ParallelTerminationStrategy: PID 18707 died... 15:45:14.889535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18707): Terminated: ok {rc=0} 15:45:14.935633 --- ParallelTerminationStrategy: PID 18708 died... 15:45:14.954889 run iperf3-srv_10.42.42.10(pid=18708): Terminated {rc=256} 15:45:15.001098 --- ParallelTerminationStrategy: PID 18709 died... 15:45:15.020311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18709): Terminated: ok {rc=0} 15:45:15.066657 --- ParallelTerminationStrategy: PID 18710 died... 15:45:15.085994 run iperf3-srv_10.42.42.10(pid=18710): Terminated {rc=256} 15:45:15.131959 --- ParallelTerminationStrategy: PID 18711 died... 15:45:15.151276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18711): Terminated: ok {rc=0} 15:45:15.197624 --- ParallelTerminationStrategy: PID 18712 died... 15:45:15.217233 run iperf3-srv_10.42.42.10(pid=18712): Terminated {rc=256} 15:45:15.263367 --- ParallelTerminationStrategy: PID 18715 died... 15:45:15.282868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18715): Terminated: ok {rc=0} 15:45:15.329411 --- ParallelTerminationStrategy: PID 18718 died... 15:45:15.348856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18718): Terminated: ok {rc=0} 15:45:15.395463 --- ParallelTerminationStrategy: PID 18721 died... 15:45:15.415288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18721): Terminated: ok {rc=0} 15:45:15.502176 bus /gobi_4: Setting Powered False 15:45:16.597637 bus /gobi_4: Setting Powered False 15:45:17.710749 bus /gobi_1: Setting Powered False 15:45:18.807423 bus /gobi_1: Setting Powered False 15:45:19.922565 bus /gobi_0: Setting Powered False 15:45:21.020182 bus /gobi_0: Setting Powered False 15:45:22.136060 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 15:45:23.235035 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:23.246753 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:45:23.303923 tst ping.py: using LAC 22058 15:45:23.419224 tst ping.py: using RAC 128 15:45:23.533194 tst ping.py: using CellId 22058 15:45:23.647953 tst ping.py: using BVCI 22059 15:45:23.755222 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:23.766186 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:23.776707 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:23.787366 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:23.797865 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:23.808278 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:23.818964 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:23.829904 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:23.943849 tst ping.py:19: start network... 15:45:24.140637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:24.595708 run create_hlr_db(pid=18723): Launched 15:45:24.718023 bus /gobi_6: Setting Powered False 15:45:25.780356 run create_hlr_db(pid=18723): Terminated: ok {rc=0} 15:45:26.222343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18725): Launched 15:45:26.539752 run osmo-hlr_10.42.42.2(pid=18726): Launched 15:45:26.660882 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:27.216002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18728): Launched 15:45:27.532160 run osmo-stp_10.42.42.5(pid=18729): Launched 15:45:27.652775 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:28.199042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18731): Launched 15:45:28.318779 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:28.585887 run patchelf(pid=18732): Launched 15:45:28.760186 run osmo-stp_10.42.42.5(pid=18729): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18729)] 15:45:28.893342 run osmo-stp_10.42.42.5(pid=18729): stdout: | (launched: 2022-12-09_15:45:27.473877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:29.028658 run osmo-stp_10.42.42.5(pid=18729): stderr: | [0;m[38;5;43m20221209154527666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154527666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154527667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154527667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154527667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154527668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154527668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:29.164181 run osmo-stp_10.42.42.5(pid=18729): stdout: | (launched: 2022-12-09_15:45:27.473877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:29.293186 run osmo-stp_10.42.42.5(pid=18729): stderr: | [0;m[38;5;43m20221209154527666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154527666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154527667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154527667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154527667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154527668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154527668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:29.446866 run patchelf(pid=18732): Terminating (SIGINT) 15:45:29.622609 run patchelf(pid=18732): Terminated: ok {rc=0} 15:45:29.749325 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18729): Process ended prematurely: osmo-stp_10.42.42.5(pid=18729) [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18729)] [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 15:45:29.758550 tst ping.py:22: Test FAILED (6.5 sec) 15:45:29.786689 run osmo-hlr_10.42.42.2(pid=18726): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18726)] 15:45:29.836166 run osmo-hlr_10.42.42.2(pid=18726): stdout: | (launched: 2022-12-09_15:45:26.480837) 15:45:29.887456 run osmo-hlr_10.42.42.2(pid=18726): stderr: | [0;m[1;31m20221209154526678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154526679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154526679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154526679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154526679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154526679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154526691 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154526699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154526699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154526699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:29.939241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18725): Terminating (SIGTERM) 15:45:29.980663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18728): Terminating (SIGTERM) 15:45:30.022324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18731): Terminating (SIGTERM) 15:45:30.064405 --- ParallelTerminationStrategy: PID 18725 died... 15:45:30.084361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18725): Terminated: ok {rc=0} 15:45:30.130809 --- ParallelTerminationStrategy: PID 18728 died... 15:45:30.150345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18728): Terminated: ok {rc=0} 15:45:30.197420 --- ParallelTerminationStrategy: PID 18731 died... 15:45:30.216607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18731): Terminated: ok {rc=0} 15:45:30.304694 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 15:45:31.399312 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:31.414649 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:45:31.478331 tst ping_idle_ping.py: using LAC 22059 15:45:31.611105 tst ping_idle_ping.py: using RAC 129 15:45:31.729405 tst ping_idle_ping.py: using CellId 22059 15:45:31.883531 tst ping_idle_ping.py: using BVCI 22060 15:45:31.991849 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:32.003236 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:32.014499 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:32.025690 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:32.037997 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:32.049625 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:32.061590 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:32.073358 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:32.194795 tst ping_idle_ping.py:24: start network... 15:45:32.411854 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:32.906256 run create_hlr_db(pid=18734): Launched 15:45:33.027430 bus /gobi_6: Setting Powered False 15:45:34.090290 run create_hlr_db(pid=18734): Terminated: ok {rc=0} 15:45:34.532397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18736): Launched 15:45:34.850896 run osmo-hlr_10.42.42.2(pid=18737): Launched 15:45:34.971725 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:35.520808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18739): Launched 15:45:35.837648 run osmo-stp_10.42.42.5(pid=18740): Launched 15:45:35.957740 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:36.502256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18742): Launched 15:45:36.622845 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:36.891549 run patchelf(pid=18743): Launched 15:45:37.066944 run osmo-stp_10.42.42.5(pid=18740): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18740)] 15:45:37.201185 run osmo-stp_10.42.42.5(pid=18740): stdout: | (launched: 2022-12-09_15:45:35.779014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:37.336654 run osmo-stp_10.42.42.5(pid=18740): stderr: | [0;m[38;5;43m20221209154535972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154535972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154535972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154535973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154535974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154535974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154535974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:37.473314 run osmo-stp_10.42.42.5(pid=18740): stdout: | (launched: 2022-12-09_15:45:35.779014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:37.602873 run osmo-stp_10.42.42.5(pid=18740): stderr: | [0;m[38;5;43m20221209154535972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154535972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154535972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154535973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154535974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154535974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154535974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:37.756415 run patchelf(pid=18743): Terminating (SIGINT) 15:45:37.932870 run patchelf(pid=18743): Terminated: ok {rc=0} 15:45:38.060428 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18740): Process ended prematurely: osmo-stp_10.42.42.5(pid=18740) [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18740)] [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 15:45:38.069808 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 15:45:38.097821 run osmo-hlr_10.42.42.2(pid=18737): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18737)] 15:45:38.148149 run osmo-hlr_10.42.42.2(pid=18737): stdout: | (launched: 2022-12-09_15:45:34.791942) 15:45:38.200004 run osmo-hlr_10.42.42.2(pid=18737): stderr: | [0;m[1;31m20221209154534992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154534993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154534993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154534993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154534993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154534993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154535005 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154535013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154535013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154535013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:38.251997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18736): Terminating (SIGTERM) 15:45:38.293430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18739): Terminating (SIGTERM) 15:45:38.335074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18742): Terminating (SIGTERM) 15:45:38.376661 --- ParallelTerminationStrategy: PID 18736 died... 15:45:38.396335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18736): Terminated: ok {rc=0} 15:45:38.442513 --- ParallelTerminationStrategy: PID 18739 died... 15:45:38.461716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18739): Terminated: ok {rc=0} 15:45:38.507681 --- ParallelTerminationStrategy: PID 18742 died... 15:45:38.527344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18742): Terminated: ok {rc=0} 15:45:38.614045 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:45:39.896547 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:45:39.902843 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:45:39.923883 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 15:45:39.963044 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 15:45:40.048698 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:45:40.069338 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 15:45:40.108262 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 15:45:40.700061 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 15:45:40.747427 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:40.758195 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:45:40.815334 tst cs_paging_gprs_active.py: using LAC 22060 15:45:40.932633 tst cs_paging_gprs_active.py: using RAC 130 15:45:41.048471 tst cs_paging_gprs_active.py: using CellId 22060 15:45:41.174122 tst cs_paging_gprs_active.py: using BVCI 22061 15:45:41.290359 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:41.301696 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:41.312580 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:41.324072 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:41.335224 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:41.346572 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:41.358444 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:41.369667 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:41.380654 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:45:41.496185 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:45:41.613414 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:45:41.830911 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:42.155214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18748): Launched 15:45:42.435773 run iperf3-srv_10.42.42.10(pid=18749): Launched 15:45:42.555972 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:45:42.772228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:43.095346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18750): Launched 15:45:43.375308 run iperf3-srv_10.42.42.10(pid=18751): Launched 15:45:43.496157 tst cs_paging_gprs_active.py:38: start network... 15:45:43.712110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:44.208868 run create_hlr_db(pid=18752): Launched 15:45:44.331868 bus /gobi_6: Setting Powered False 15:45:45.395623 run create_hlr_db(pid=18752): Terminated: ok {rc=0} 15:45:45.824721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18754): Launched 15:45:46.175344 run osmo-hlr_10.42.42.2(pid=18755): Launched 15:45:46.397931 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:47.081443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18757): Launched 15:45:47.418988 run osmo-stp_10.42.42.5(pid=18758): Launched 15:45:47.542628 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:48.097539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18760): Launched 15:45:48.220552 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:48.492240 run patchelf(pid=18761): Launched 15:45:48.670708 run osmo-stp_10.42.42.5(pid=18758): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18758)] 15:45:48.807019 run osmo-stp_10.42.42.5(pid=18758): stdout: | (launched: 2022-12-09_15:45:47.359534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:48.944302 run osmo-stp_10.42.42.5(pid=18758): stderr: | [0;m[38;5;43m20221209154547550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154547551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154547551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154547551 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154547552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154547552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154547552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:49.081823 run osmo-stp_10.42.42.5(pid=18758): stdout: | (launched: 2022-12-09_15:45:47.359534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:49.213180 run osmo-stp_10.42.42.5(pid=18758): stderr: | [0;m[38;5;43m20221209154547550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154547551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154547551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154547551 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154547552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154547552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154547552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:49.369189 run patchelf(pid=18761): Terminating (SIGINT) 15:45:49.550180 run patchelf(pid=18761): Terminated: ok {rc=0} 15:45:49.680161 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18758): Process ended prematurely: osmo-stp_10.42.42.5(pid=18758) [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18758)] [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 15:45:49.690110 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 15:45:49.718064 run osmo-hlr_10.42.42.2(pid=18755): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18755)] 15:45:49.768126 run osmo-hlr_10.42.42.2(pid=18755): stdout: | (launched: 2022-12-09_15:45:46.110971) 15:45:49.819301 run osmo-hlr_10.42.42.2(pid=18755): stderr: | [0;m[1;31m20221209154546437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154546437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154546437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154546437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154546437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154546437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154546453 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154546462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154546462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154546462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:49.870740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18748): Terminating (SIGTERM) 15:45:49.912126 run iperf3-srv_10.42.42.10(pid=18749): Terminating (SIGTERM) 15:45:49.953261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18750): Terminating (SIGTERM) 15:45:49.994655 run iperf3-srv_10.42.42.10(pid=18751): Terminating (SIGTERM) 15:45:50.035764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18754): Terminating (SIGTERM) 15:45:50.077051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18757): Terminating (SIGTERM) 15:45:50.118385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18760): Terminating (SIGTERM) 15:45:50.159701 --- ParallelTerminationStrategy: PID 18748 died... 15:45:50.179365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18748): Terminated: ok {rc=0} 15:45:50.225342 --- ParallelTerminationStrategy: PID 18749 died... 15:45:50.244286 run iperf3-srv_10.42.42.10(pid=18749): Terminated {rc=256} 15:45:50.290281 --- ParallelTerminationStrategy: PID 18750 died... 15:45:50.309473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18750): Terminated: ok {rc=0} 15:45:50.355338 --- ParallelTerminationStrategy: PID 18751 died... 15:45:50.374519 run iperf3-srv_10.42.42.10(pid=18751): Terminated {rc=256} 15:45:50.420246 --- ParallelTerminationStrategy: PID 18754 died... 15:45:50.439723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18754): Terminated: ok {rc=0} 15:45:50.485684 --- ParallelTerminationStrategy: PID 18757 died... 15:45:50.504760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18757): Terminated: ok {rc=0} 15:45:50.550629 --- ParallelTerminationStrategy: PID 18760 died... 15:45:50.569859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18760): Terminated: ok {rc=0} 15:45:50.657483 bus /gobi_0: Setting Powered False 15:45:51.755803 bus /gobi_0: Setting Powered False 15:45:52.870191 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 15:45:54.016332 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:54.028174 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:45:54.088740 tst iperf3.py: using LAC 22061 15:45:54.214944 tst iperf3.py: using RAC 131 15:45:54.340391 tst iperf3.py: using CellId 22061 15:45:54.466083 tst iperf3.py: using BVCI 22062 15:45:54.578534 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:54.589824 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:54.600382 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:54.610967 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:54.621511 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:54.631973 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:54.642626 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:54.653082 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:45:54.663749 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:45:54.781583 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:45:54.999773 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:55.324417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18762): Launched 15:45:55.606856 run iperf3-srv_10.42.42.10(pid=18763): Launched 15:45:55.727091 tst iperf3.py:8: start network... 15:45:55.945203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:56.443332 run create_hlr_db(pid=18764): Launched 15:45:56.565360 bus /gobi_6: Setting Powered False 15:45:57.628644 run create_hlr_db(pid=18764): Terminated: ok {rc=0} 15:45:58.056656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18766): Launched 15:45:58.357835 run osmo-hlr_10.42.42.2(pid=18767): Launched 15:45:58.471133 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:58.987723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18769): Launched 15:45:59.287842 run osmo-stp_10.42.42.5(pid=18770): Launched 15:45:59.401881 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:59.920285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18772): Launched 15:46:00.035277 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:00.289921 run patchelf(pid=18773): Launched 15:46:00.455599 run osmo-stp_10.42.42.5(pid=18770): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18770)] 15:46:00.582618 run osmo-stp_10.42.42.5(pid=18770): stdout: | (launched: 2022-12-09_15:45:59.231881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:00.711742 run osmo-stp_10.42.42.5(pid=18770): stderr: | [0;m[38;5;43m20221209154559403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154559403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154559403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154559404 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154559404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154559404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154559404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:00.842904 run osmo-stp_10.42.42.5(pid=18770): stdout: | (launched: 2022-12-09_15:45:59.231881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:00.989196 run osmo-stp_10.42.42.5(pid=18770): stderr: | [0;m[38;5;43m20221209154559403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154559403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154559403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154559404 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154559404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154559404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154559404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:01.152848 run patchelf(pid=18773): Terminating (SIGINT) 15:46:01.339379 run patchelf(pid=18773): Terminated: ok {rc=0} 15:46:01.476159 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18770): Process ended prematurely: osmo-stp_10.42.42.5(pid=18770) [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18770)] [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 15:46:01.487464 tst iperf3.py:8: Test FAILED (7.5 sec) 15:46:01.519335 run osmo-hlr_10.42.42.2(pid=18767): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18767)] 15:46:01.572502 run osmo-hlr_10.42.42.2(pid=18767): stdout: | (launched: 2022-12-09_15:45:58.301860) 15:46:01.627765 run osmo-hlr_10.42.42.2(pid=18767): stderr: | [0;m[1;31m20221209154558480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154558480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154558481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154558481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154558481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154558481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154558493 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154558502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154558502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154558502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:01.682894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18762): Terminating (SIGTERM) 15:46:01.727150 run iperf3-srv_10.42.42.10(pid=18763): Terminating (SIGTERM) 15:46:01.772846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18766): Terminating (SIGTERM) 15:46:01.818635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18769): Terminating (SIGTERM) 15:46:01.865218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18772): Terminating (SIGTERM) 15:46:01.912407 --- ParallelTerminationStrategy: PID 18762 died... 15:46:01.933036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18762): Terminated: ok {rc=0} 15:46:01.983943 --- ParallelTerminationStrategy: PID 18763 died... 15:46:02.005329 run iperf3-srv_10.42.42.10(pid=18763): Terminated {rc=256} 15:46:02.054322 --- ParallelTerminationStrategy: PID 18766 died... 15:46:02.075114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18766): Terminated: ok {rc=0} 15:46:02.124053 --- ParallelTerminationStrategy: PID 18769 died... 15:46:02.144428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18769): Terminated: ok {rc=0} 15:46:02.194543 --- ParallelTerminationStrategy: PID 18772 died... 15:46:02.215577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18772): Terminated: ok {rc=0} 15:46:02.303379 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 15:46:03.449557 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:03.462295 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:46:03.521412 tst iperf3m4.py: using LAC 22062 15:46:03.649390 tst iperf3m4.py: using RAC 132 15:46:03.776334 tst iperf3m4.py: using CellId 22062 15:46:03.902791 tst iperf3m4.py: using BVCI 22063 15:46:04.018792 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:04.030191 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:04.041249 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:04.052471 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:04.063758 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:04.075137 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:04.086520 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:04.097725 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:04.109224 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:04.223952 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:04.346681 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:04.463073 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:04.583272 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:46:04.801095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:05.125286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18774): Launched 15:46:05.406047 run iperf3-srv_10.42.42.10(pid=18775): Launched 15:46:05.526387 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:46:05.743679 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:06.066898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18776): Launched 15:46:06.347086 run iperf3-srv_10.42.42.10(pid=18777): Launched 15:46:06.467465 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:46:06.684510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:07.007884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18778): Launched 15:46:07.288313 run iperf3-srv_10.42.42.10(pid=18779): Launched 15:46:07.408389 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:46:07.626376 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:07.950113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18780): Launched 15:46:08.230048 run iperf3-srv_10.42.42.10(pid=18781): Launched 15:46:08.349652 tst iperf3m4.py:8: start network... 15:46:08.566844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:09.065121 run create_hlr_db(pid=18782): Launched 15:46:09.186718 bus /gobi_6: Setting Powered False 15:46:10.250043 run create_hlr_db(pid=18782): Terminated: ok {rc=0} 15:46:10.679097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18784): Launched 15:46:10.979522 run osmo-hlr_10.42.42.2(pid=18785): Launched 15:46:11.093869 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:11.614974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18787): Launched 15:46:11.916122 run osmo-stp_10.42.42.5(pid=18788): Launched 15:46:12.028724 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:12.549657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18790): Launched 15:46:12.663775 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:12.917491 run patchelf(pid=18791): Launched 15:46:13.083189 run osmo-stp_10.42.42.5(pid=18788): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18788)] 15:46:13.209591 run osmo-stp_10.42.42.5(pid=18788): stdout: | (launched: 2022-12-09_15:46:11.859286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:13.337423 run osmo-stp_10.42.42.5(pid=18788): stderr: | [0;m[38;5;43m20221209154612032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154612032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154612032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154612033 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154612033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154612033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154612033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:13.465432 run osmo-stp_10.42.42.5(pid=18788): stdout: | (launched: 2022-12-09_15:46:11.859286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:13.587049 run osmo-stp_10.42.42.5(pid=18788): stderr: | [0;m[38;5;43m20221209154612032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154612032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154612032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154612033 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154612033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154612033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154612033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:13.731776 run patchelf(pid=18791): Terminating (SIGINT) 15:46:13.899013 run patchelf(pid=18791): Terminated: ok {rc=0} 15:46:14.020155 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18788): Process ended prematurely: osmo-stp_10.42.42.5(pid=18788) [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18788)] [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 15:46:14.029459 tst iperf3m4.py:8: Test FAILED (10.6 sec) 15:46:14.056379 run osmo-hlr_10.42.42.2(pid=18785): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18785)] 15:46:14.103240 run osmo-hlr_10.42.42.2(pid=18785): stdout: | (launched: 2022-12-09_15:46:10.923210) 15:46:14.151648 run osmo-hlr_10.42.42.2(pid=18785): stderr: | [0;m[1;31m20221209154611102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154611102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154611102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154611102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154611102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154611102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154611115 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154611124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154611124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154611124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:14.200411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18774): Terminating (SIGTERM) 15:46:14.239593 run iperf3-srv_10.42.42.10(pid=18775): Terminating (SIGTERM) 15:46:14.278892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18776): Terminating (SIGTERM) 15:46:14.318311 run iperf3-srv_10.42.42.10(pid=18777): Terminating (SIGTERM) 15:46:14.357369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18778): Terminating (SIGTERM) 15:46:14.397056 run iperf3-srv_10.42.42.10(pid=18779): Terminating (SIGTERM) 15:46:14.437450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18780): Terminating (SIGTERM) 15:46:14.481147 run iperf3-srv_10.42.42.10(pid=18781): Terminating (SIGTERM) 15:46:14.522751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18784): Terminating (SIGTERM) 15:46:14.564324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18787): Terminating (SIGTERM) 15:46:14.606277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18790): Terminating (SIGTERM) 15:46:14.648286 --- ParallelTerminationStrategy: PID 18774 died... 15:46:14.668163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18774): Terminated: ok {rc=0} 15:46:14.714529 --- ParallelTerminationStrategy: PID 18775 died... 15:46:14.734016 run iperf3-srv_10.42.42.10(pid=18775): Terminated {rc=256} 15:46:14.780268 --- ParallelTerminationStrategy: PID 18776 died... 15:46:14.799900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18776): Terminated: ok {rc=0} 15:46:14.846080 --- ParallelTerminationStrategy: PID 18777 died... 15:46:14.865415 run iperf3-srv_10.42.42.10(pid=18777): Terminated {rc=256} 15:46:14.911453 --- ParallelTerminationStrategy: PID 18778 died... 15:46:14.930935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18778): Terminated: ok {rc=0} 15:46:14.977489 --- ParallelTerminationStrategy: PID 18779 died... 15:46:14.996883 run iperf3-srv_10.42.42.10(pid=18779): Terminated {rc=256} 15:46:15.043177 --- ParallelTerminationStrategy: PID 18780 died... 15:46:15.062611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18780): Terminated: ok {rc=0} 15:46:15.108932 --- ParallelTerminationStrategy: PID 18781 died... 15:46:15.128600 run iperf3-srv_10.42.42.10(pid=18781): Terminated {rc=256} 15:46:15.174695 --- ParallelTerminationStrategy: PID 18784 died... 15:46:15.194269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18784): Terminated: ok {rc=0} 15:46:15.240502 --- ParallelTerminationStrategy: PID 18787 died... 15:46:15.260035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18787): Terminated: ok {rc=0} 15:46:15.306250 --- ParallelTerminationStrategy: PID 18790 died... 15:46:15.325746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18790): Terminated: ok {rc=0} 15:46:15.413373 bus /gobi_4: Setting Powered False 15:46:16.518785 bus /gobi_4: Setting Powered False 15:46:17.638424 bus /gobi_1: Setting Powered False 15:46:18.735435 bus /gobi_1: Setting Powered False 15:46:19.847267 bus /gobi_0: Setting Powered False 15:46:20.943383 bus /gobi_0: Setting Powered False 15:46:22.059943 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 15:46:23.161972 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:23.173817 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:46:23.233125 tst ping.py: using LAC 22063 15:46:23.358054 tst ping.py: using RAC 133 15:46:23.487915 tst ping.py: using CellId 22063 15:46:23.610728 tst ping.py: using BVCI 22064 15:46:23.724871 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:23.736280 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:23.747363 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:23.758663 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:23.769930 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:23.781088 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:23.792596 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:23.803781 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:23.922997 tst ping.py:19: start network... 15:46:24.136466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:24.626147 run create_hlr_db(pid=18792): Launched 15:46:24.745482 bus /gobi_6: Setting Powered False 15:46:25.807591 run create_hlr_db(pid=18792): Terminated: ok {rc=0} 15:46:26.230971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18794): Launched 15:46:26.526317 run osmo-hlr_10.42.42.2(pid=18795): Launched 15:46:26.637890 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:27.149644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18797): Launched 15:46:27.442529 run osmo-stp_10.42.42.5(pid=18798): Launched 15:46:27.554970 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:28.063095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18800): Launched 15:46:28.174658 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:28.423269 run patchelf(pid=18801): Launched 15:46:28.586389 run osmo-stp_10.42.42.5(pid=18798): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18798)] 15:46:28.710765 run osmo-stp_10.42.42.5(pid=18798): stdout: | (launched: 2022-12-09_15:46:27.387984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:28.836787 run osmo-stp_10.42.42.5(pid=18798): stderr: | [0;m[38;5;43m20221209154627557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154627557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154627557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154627558 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154627558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154627558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154627558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:28.963213 run osmo-stp_10.42.42.5(pid=18798): stdout: | (launched: 2022-12-09_15:46:27.387984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:29.083705 run osmo-stp_10.42.42.5(pid=18798): stderr: | [0;m[38;5;43m20221209154627557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154627557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154627557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154627558 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154627558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154627558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154627558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:29.226170 run patchelf(pid=18801): Terminating (SIGINT) 15:46:29.390741 run patchelf(pid=18801): Terminated: ok {rc=0} 15:46:29.509306 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18798): Process ended prematurely: osmo-stp_10.42.42.5(pid=18798) [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18798)] [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 15:46:29.517996 tst ping.py:22: Test FAILED (6.3 sec) 15:46:29.544435 run osmo-hlr_10.42.42.2(pid=18795): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18795)] 15:46:29.592114 run osmo-hlr_10.42.42.2(pid=18795): stdout: | (launched: 2022-12-09_15:46:26.471056) 15:46:29.641452 run osmo-hlr_10.42.42.2(pid=18795): stderr: | [0;m[1;31m20221209154626648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154626649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154626649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154626649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154626649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154626649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154626662 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154626670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154626670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154626670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:29.691209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18794): Terminating (SIGTERM) 15:46:29.730997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18797): Terminating (SIGTERM) 15:46:29.770835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18800): Terminating (SIGTERM) 15:46:29.810905 --- ParallelTerminationStrategy: PID 18794 died... 15:46:29.829997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18794): Terminated: ok {rc=0} 15:46:29.873589 --- ParallelTerminationStrategy: PID 18797 died... 15:46:29.891852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18797): Terminated: ok {rc=0} 15:46:29.935413 --- ParallelTerminationStrategy: PID 18800 died... 15:46:29.953852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18800): Terminated: ok {rc=0} 15:46:30.037081 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 15:46:31.122973 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:31.138757 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:46:31.210855 tst ping_idle_ping.py: using LAC 22064 15:46:31.327406 tst ping_idle_ping.py: using RAC 134 15:46:31.490974 tst ping_idle_ping.py: using CellId 22064 15:46:31.641731 tst ping_idle_ping.py: using BVCI 22065 15:46:31.765926 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:31.777412 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:31.788999 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:31.801216 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:31.812373 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:31.823617 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:31.835097 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:31.846167 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:31.961471 tst ping_idle_ping.py:24: start network... 15:46:32.192503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:32.693291 run create_hlr_db(pid=18802): Launched 15:46:32.814129 bus /gobi_6: Setting Powered False 15:46:33.877217 run create_hlr_db(pid=18802): Terminated: ok {rc=0} 15:46:34.303829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18804): Launched 15:46:34.600574 run osmo-hlr_10.42.42.2(pid=18805): Launched 15:46:34.713038 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:35.220637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18807): Launched 15:46:35.516579 run osmo-stp_10.42.42.5(pid=18808): Launched 15:46:35.628875 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:36.138208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18810): Launched 15:46:36.250496 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:36.501129 run patchelf(pid=18811): Launched 15:46:36.664498 run osmo-stp_10.42.42.5(pid=18808): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18808)] 15:46:36.788600 run osmo-stp_10.42.42.5(pid=18808): stdout: | (launched: 2022-12-09_15:46:35.461017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:36.914787 run osmo-stp_10.42.42.5(pid=18808): stderr: | [0;m[38;5;43m20221209154635633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154635633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154635633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154635634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154635634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154635634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154635634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:37.041633 run osmo-stp_10.42.42.5(pid=18808): stdout: | (launched: 2022-12-09_15:46:35.461017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:37.162426 run osmo-stp_10.42.42.5(pid=18808): stderr: | [0;m[38;5;43m20221209154635633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154635633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154635633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154635634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154635634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154635634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154635634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:37.305470 run patchelf(pid=18811): Terminating (SIGINT) 15:46:37.469844 run patchelf(pid=18811): Terminated: ok {rc=0} 15:46:37.588569 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18808): Process ended prematurely: osmo-stp_10.42.42.5(pid=18808) [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18808)] [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 15:46:37.597397 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 15:46:37.623728 run osmo-hlr_10.42.42.2(pid=18805): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18805)] 15:46:37.671288 run osmo-hlr_10.42.42.2(pid=18805): stdout: | (launched: 2022-12-09_15:46:34.544916) 15:46:37.720401 run osmo-hlr_10.42.42.2(pid=18805): stderr: | [0;m[1;31m20221209154634721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154634721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154634721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154634721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154634721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154634722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154634734 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154634742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154634743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154634743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:37.769866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18804): Terminating (SIGTERM) 15:46:37.809330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18807): Terminating (SIGTERM) 15:46:37.849179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18810): Terminating (SIGTERM) 15:46:37.889435 --- ParallelTerminationStrategy: PID 18804 died... 15:46:37.908387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18804): Terminated: ok {rc=0} 15:46:37.952214 --- ParallelTerminationStrategy: PID 18807 died... 15:46:37.970656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18807): Terminated: ok {rc=0} 15:46:38.014185 --- ParallelTerminationStrategy: PID 18810 died... 15:46:38.032755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18810): Terminated: ok {rc=0} 15:46:38.117526 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:46:39.404249 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:46:39.410905 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:46:39.431528 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 15:46:39.466144 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:46:39.519197 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:46:39.540245 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 15:46:39.574294 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:46:40.130123 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 15:46:40.136665 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:40.148414 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:46:40.206976 tst switch_tch_pdch.py: using LAC 22065 15:46:40.332054 tst switch_tch_pdch.py: using RAC 135 15:46:40.454470 tst switch_tch_pdch.py: using CellId 22065 15:46:40.581917 tst switch_tch_pdch.py: using BVCI 22066 15:46:40.688460 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:40.699748 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:40.710811 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:40.721748 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:40.732497 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:40.743879 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:40.754982 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:46:40.765876 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:46:40.884527 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:46:41.002320 tst switch_tch_pdch.py:51: start network... 15:46:41.198985 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:41.652927 run create_hlr_db(pid=18816): Launched 15:46:41.773569 bus /gobi_6: Setting Powered False 15:46:42.832907 run create_hlr_db(pid=18816): Terminated: ok {rc=0} 15:46:43.244236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18818): Launched 15:46:43.537908 run osmo-hlr_10.42.42.2(pid=18819): Launched 15:46:43.648608 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:44.167447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18821): Launched 15:46:44.461515 run osmo-stp_10.42.42.5(pid=18822): Launched 15:46:44.572014 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:45.077058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18824): Launched 15:46:45.188517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:45.436859 run patchelf(pid=18825): Launched 15:46:45.599569 run osmo-stp_10.42.42.5(pid=18822): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18822)] 15:46:45.723672 run osmo-stp_10.42.42.5(pid=18822): stdout: | (launched: 2022-12-09_15:46:44.406424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:45.867334 run osmo-stp_10.42.42.5(pid=18822): stderr: | [0;m[38;5;43m20221209154644575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154644575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154644576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154644576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154644578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154644579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154644579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:46.011385 run osmo-stp_10.42.42.5(pid=18822): stdout: | (launched: 2022-12-09_15:46:44.406424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:46.147134 run osmo-stp_10.42.42.5(pid=18822): stderr: | [0;m[38;5;43m20221209154644575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154644575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154644576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154644576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154644578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154644579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154644579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:46.306770 run patchelf(pid=18825): Terminating (SIGINT) 15:46:46.490444 run patchelf(pid=18825): Terminated: ok {rc=0} 15:46:46.623406 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18822): Process ended prematurely: osmo-stp_10.42.42.5(pid=18822) [trial-2361↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18822)] [trial-2361↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 15:46:46.633757 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 15:46:46.665543 run osmo-hlr_10.42.42.2(pid=18819): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18819)] 15:46:46.717929 run osmo-hlr_10.42.42.2(pid=18819): stdout: | (launched: 2022-12-09_15:46:43.482998) 15:46:46.773389 run osmo-hlr_10.42.42.2(pid=18819): stderr: | [0;m[1;31m20221209154643661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154643661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154643661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154643661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154643661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154643661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154643674 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154643683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154643683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154643683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:46.829178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18818): Terminating (SIGTERM) 15:46:46.874073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18821): Terminating (SIGTERM) 15:46:46.920459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18824): Terminating (SIGTERM) 15:46:46.968219 --- ParallelTerminationStrategy: PID 18818 died... 15:46:46.989177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18818): Terminated: ok {rc=0} 15:46:47.040832 --- ParallelTerminationStrategy: PID 18821 died... 15:46:47.061768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18821): Terminated: ok {rc=0} 15:46:47.111320 --- ParallelTerminationStrategy: PID 18824 died... 15:46:47.132105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18824): Terminated: ok {rc=0} 15:46:47.225658 bus /gobi_0: Setting Powered False 15:46:48.320856 bus /gobi_0: Setting Powered False 15:46:49.435551 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 15:46:50.675429 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:46:50.681526 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 15:46:50.703029 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 15:46:50.739453 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 15:46:50.792413 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 15:46:50.813889 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 15:46:50.849424 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 15:46:51.405193 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 15:46:51.410393 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:46:51.421708 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 15:46:51.480275 tst switch_tch_pdch.py: using LAC 22066 15:46:51.605790 tst switch_tch_pdch.py: using RAC 136 15:46:51.731112 tst switch_tch_pdch.py: using CellId 22066 15:46:51.848679 tst switch_tch_pdch.py: using BVCI 22067 15:46:51.955289 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:46:51.966284 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:46:51.976928 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:46:51.987637 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:46:51.998117 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:46:52.008550 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:46:52.019281 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:46:52.029882 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:46:52.149393 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:46:52.265422 tst switch_tch_pdch.py:51: start network... 15:46:52.463199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:52.893960 run create_hlr_db(pid=18829): Launched 15:46:53.014284 bus /gobi_6: Setting Powered False 15:46:54.073680 run create_hlr_db(pid=18829): Terminated: ok {rc=0} 15:46:54.481549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18831): Launched 15:46:54.799580 run osmo-hlr_10.42.42.2(pid=18832): Launched 15:46:54.919471 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:55.441032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18834): Launched 15:46:55.758380 run osmo-stp_10.42.42.5(pid=18835): Launched 15:46:55.878602 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:56.400301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18837): Launched 15:46:56.522028 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:56.790491 run patchelf(pid=18838): Launched 15:46:56.966630 run osmo-stp_10.42.42.5(pid=18835): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18835)] 15:46:57.100841 run osmo-stp_10.42.42.5(pid=18835): stdout: | (launched: 2022-12-09_15:46:55.699724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:57.237302 run osmo-stp_10.42.42.5(pid=18835): stderr: | [0;m[38;5;43m20221209154655892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154655892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154655893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154655893 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154655894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154655894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154655894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:57.373844 run osmo-stp_10.42.42.5(pid=18835): stdout: | (launched: 2022-12-09_15:46:55.699724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:57.504430 run osmo-stp_10.42.42.5(pid=18835): stderr: | [0;m[38;5;43m20221209154655892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154655892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154655893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154655893 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154655894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154655894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154655894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:57.659014 run patchelf(pid=18838): Terminating (SIGINT) 15:46:57.835290 run patchelf(pid=18838): Terminated: ok {rc=0} 15:46:57.963393 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18835): Process ended prematurely: osmo-stp_10.42.42.5(pid=18835) [trial-2361↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18835)] [trial-2361↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 15:46:57.972678 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 15:46:58.001154 run osmo-hlr_10.42.42.2(pid=18832): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18832)] 15:46:58.051404 run osmo-hlr_10.42.42.2(pid=18832): stdout: | (launched: 2022-12-09_15:46:54.739766) 15:46:58.103319 run osmo-hlr_10.42.42.2(pid=18832): stderr: | [0;m[1;31m20221209154654937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154654938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154654938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154654938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154654938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154654938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154654950 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154654958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154654958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154654958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:58.155553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18831): Terminating (SIGTERM) 15:46:58.197441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18834): Terminating (SIGTERM) 15:46:58.239350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18837): Terminating (SIGTERM) 15:46:58.281675 --- ParallelTerminationStrategy: PID 18831 died... 15:46:58.301618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18831): Terminated: ok {rc=0} 15:46:58.348237 --- ParallelTerminationStrategy: PID 18834 died... 15:46:58.367821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18834): Terminated: ok {rc=0} 15:46:58.414433 --- ParallelTerminationStrategy: PID 18837 died... 15:46:58.433952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18837): Terminated: ok {rc=0} 15:46:58.522327 bus /gobi_0: Setting Powered False 15:46:59.619650 bus /gobi_0: Setting Powered False 15:47:00.736499 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_sms:oc2g --------------------------------------------------------------------- 15:47:01.991605 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:47:01.995215 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 15:47:02.016011 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 15:47:02.023714 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 15:47:02.076132 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 15:47:02.097364 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 15:47:02.104522 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 15:47:02.638757 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 15:47:02.643586 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 15:47:02.654133 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 15:47:02.687322 tst mo_mt_sms.py: using LAC 22067 15:47:02.800141 tst mo_mt_sms.py: using RAC 137 15:47:02.922479 tst mo_mt_sms.py: using CellId 22067 15:47:03.043803 tst mo_mt_sms.py: using BVCI 22068 15:47:03.158307 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 15:47:03.273937 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 15:47:03.387099 tst mo_mt_sms.py:9: start nitb and bts... 15:47:03.584133 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:47:04.182751 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18842): Launched 15:47:04.478732 run osmo-nitb_10.42.42.2(pid=18843): Launched 15:47:04.640136 run osmo-nitb_10.42.42.2(pid=18843): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18843)] 15:47:04.772169 run osmo-nitb_10.42.42.2(pid=18843): stdout: | (launched: 2022-12-09_15:47:04.423280) 15:47:04.906086 run osmo-nitb_10.42.42.2(pid=18843): stderr: | (launched: 2022-12-09_15:47:04.467177) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:47:05.039536 run osmo-nitb_10.42.42.2(pid=18843): stdout: | (launched: 2022-12-09_15:47:04.423280) 15:47:05.167647 run osmo-nitb_10.42.42.2(pid=18843): stderr: | (launched: 2022-12-09_15:47:04.467177) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18843): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18843) [trial-2361↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18843)] 15:47:05.588441 tst osmo-nitb_10.42.42.2(pid=18843): stdout: | (launched: 2022-12-09_15:47:04.423280) 15:47:05.706803 tst osmo-nitb_10.42.42.2(pid=18843): stderr: | (launched: 2022-12-09_15:47:04.467177) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:47:05.846949 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=18843): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18843) [trial-2361↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18843)] [trial-2361↪nitb_sms:oc2g↪mo_mt_sms.py:11] 15:47:05.855130 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 15:47:05.861491 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18842): Terminating (SIGTERM) 15:47:06.069018 --- ParallelTerminationStrategy: PID 18842 died... 15:47:06.089229 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18842): Terminated: ok {rc=0} 15:47:06.174187 bus /sierra_3: Setting Powered False 15:47:07.271019 bus /sierra_3: Setting Powered False 15:47:08.391328 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 sms:oc2g --------------------------------------------------------------------- 15:47:09.568473 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:47:09.572604 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 15:47:09.592813 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 15:47:09.619379 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 15:47:09.670962 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 15:47:09.691435 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 15:47:09.717561 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 15:47:10.263323 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 sms:oc2g mo_mt_sms.py ---------------------------------------------- 15:47:10.268097 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:47:10.278514 tst sms:oc2g: Using 1 x bts (candidates: 1) 15:47:10.311798 tst mo_mt_sms.py: using LAC 22068 15:47:10.437210 tst mo_mt_sms.py: using RAC 138 15:47:10.565419 tst mo_mt_sms.py: using CellId 22068 15:47:10.687626 tst mo_mt_sms.py: using BVCI 22069 15:47:10.802102 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:47:10.812895 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:47:10.823833 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:47:10.835393 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:47:10.846856 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:47:10.858256 tst sms:oc2g: Using 1 x modem (candidates: 2) 15:47:10.974563 tst sms:oc2g: Using 1 x modem (candidates: 2) 15:47:11.087525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:11.543388 run create_hlr_db(pid=18847): Launched 15:47:11.663541 bus /sierra_2: Setting Powered False 15:47:12.722015 run create_hlr_db(pid=18847): Terminated: ok {rc=0} 15:47:13.154761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18849): Launched 15:47:13.471027 run osmo-hlr_10.42.42.2(pid=18850): Launched 15:47:13.591467 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:14.136511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18852): Launched 15:47:14.453235 run osmo-stp_10.42.42.5(pid=18853): Launched 15:47:14.574436 run osmo-msc_10.42.42.6: Starting osmo-msc 15:47:15.147603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18855): Launched 15:47:15.464918 run osmo-msc_10.42.42.6(pid=18856): Launched 15:47:15.642366 run osmo-stp_10.42.42.5(pid=18853): ERR: Terminated: ERROR {rc=1} [trial-2361↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18853)] 15:47:15.777643 run osmo-stp_10.42.42.5(pid=18853): stdout: | (launched: 2022-12-09_15:47:14.394436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:16.043963 run osmo-stp_10.42.42.5(pid=18853): stderr: | [0;m[38;5;43m20221209154714585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154714586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154714586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154714586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154714587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154714587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154714587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:16.187841 run osmo-stp_10.42.42.5(pid=18853): stdout: | (launched: 2022-12-09_15:47:14.394436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:16.316755 run osmo-stp_10.42.42.5(pid=18853): stderr: | [0;m[38;5;43m20221209154714585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154714586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154714586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154714586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154714587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154714587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154714587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:16.473494 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=18853): Process ended prematurely: osmo-stp_10.42.42.5(pid=18853) [trial-2361↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18853)] [trial-2361↪sms:oc2g↪mo_mt_sms.py:16] 15:47:16.483248 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 15:47:16.512502 run osmo-hlr_10.42.42.2(pid=18850): ERR: Terminated: ERROR {rc=237} [trial-2361↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18850)] 15:47:16.563891 run osmo-hlr_10.42.42.2(pid=18850): stdout: | (launched: 2022-12-09_15:47:13.412342) 15:47:16.617143 run osmo-hlr_10.42.42.2(pid=18850): stderr: | [0;m[1;31m20221209154713611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154713611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154713611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154713611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154713611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154713611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154713627 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154713637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154713637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154713637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:16.690325 run osmo-msc_10.42.42.6(pid=18856): ERR: Terminated: ERROR {rc=2} [trial-2361↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18856)] 15:47:16.741157 run osmo-msc_10.42.42.6(pid=18856): stdout: | (launched: 2022-12-09_15:47:15.406186) 15:47:16.792684 run osmo-msc_10.42.42.6(pid=18856): stderr: | [0;m[38;5;43m20221209154715728 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154715728 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f484e657c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154715728 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154715728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154715728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154715729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154715730 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154715731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154715731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154715731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:47:16.845567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18849): Terminating (SIGTERM) 15:47:16.890016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18852): Terminating (SIGTERM) 15:47:16.932818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18855): Terminating (SIGTERM) 15:47:16.977746 --- ParallelTerminationStrategy: PID 18849 died... 15:47:16.998375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18849): Terminated: ok {rc=0} 15:47:17.047874 --- ParallelTerminationStrategy: PID 18852 died... 15:47:17.068247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18852): Terminated: ok {rc=0} 15:47:17.116591 --- ParallelTerminationStrategy: PID 18855 died... 15:47:17.136811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18855): Terminated: ok {rc=0} 15:47:17.225659 bus /sierra_3: Setting Powered False 15:47:18.328165 bus /sierra_3: Setting Powered False 15:47:19.442560 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_ussd:oc2g --------------------------------------------------------------------- 15:47:20.660266 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:47:20.664207 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 15:47:20.685054 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 15:47:20.693300 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 15:47:20.728890 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 15:47:20.749307 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 15:47:20.755869 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 15:47:21.275390 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2361 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 15:47:21.280214 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 15:47:21.290788 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 15:47:21.325346 tst assert_extension.py: using LAC 22069 15:47:21.449230 tst assert_extension.py: using RAC 139 15:47:21.571829 tst assert_extension.py: using CellId 22069 15:47:21.693578 tst assert_extension.py: using BVCI 22070 15:47:21.802552 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 15:47:21.918100 tst assert_extension.py:10: start nitb and bts... 15:47:22.115706 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:47:22.715380 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18862): Launched 15:47:23.008399 run osmo-nitb_10.42.42.2(pid=18863): Launched 15:47:23.170768 run osmo-nitb_10.42.42.2(pid=18863): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18863)] 15:47:23.303013 run osmo-nitb_10.42.42.2(pid=18863): stdout: | (launched: 2022-12-09_15:47:22.953599) 15:47:23.436749 run osmo-nitb_10.42.42.2(pid=18863): stderr: | (launched: 2022-12-09_15:47:22.997251) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:47:23.570803 run osmo-nitb_10.42.42.2(pid=18863): stdout: | (launched: 2022-12-09_15:47:22.953599) 15:47:23.698574 run osmo-nitb_10.42.42.2(pid=18863): stderr: | (launched: 2022-12-09_15:47:22.997251) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18863): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18863) [trial-2361↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18863)] 15:47:24.118961 tst osmo-nitb_10.42.42.2(pid=18863): stdout: | (launched: 2022-12-09_15:47:22.953599) 15:47:24.238046 tst osmo-nitb_10.42.42.2(pid=18863): stderr: | (launched: 2022-12-09_15:47:22.997251) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:47:24.377940 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=18863): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18863) [trial-2361↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18863)] [trial-2361↪nitb_ussd:oc2g↪assert_extension.py:12] 15:47:24.385958 tst assert_extension.py:12: Test FAILED (3.1 sec) 15:47:24.392365 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18862): Terminating (SIGTERM) 15:47:24.600583 --- ParallelTerminationStrategy: PID 18862 died... 15:47:24.620930 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18862): Terminated: ok {rc=0} 15:47:24.707056 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 ussd:oc2g --------------------------------------------------------------------- 15:47:25.867240 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:47:25.871235 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 15:47:25.891200 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 15:47:25.921181 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 15:47:25.956500 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 15:47:25.977496 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 15:47:26.006074 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 15:47:26.533982 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2361 ussd:oc2g assert_extension.py ---------------------------------------------- 15:47:26.539370 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:47:26.550399 tst ussd:oc2g: Using 1 x bts (candidates: 1) 15:47:26.587130 tst assert_extension.py: using LAC 22070 15:47:26.712037 tst assert_extension.py: using RAC 140 15:47:26.834816 tst assert_extension.py: using CellId 22070 15:47:26.957825 tst assert_extension.py: using BVCI 22071 15:47:27.071668 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:47:27.082577 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:47:27.093629 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:47:27.105151 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:47:27.116642 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:47:27.128192 tst ussd:oc2g: Using 1 x modem (candidates: 1) 15:47:27.244926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:27.701391 run create_hlr_db(pid=18867): Launched 15:47:27.826641 bus /sierra_2: Setting Powered False 15:47:28.889726 run create_hlr_db(pid=18867): Terminated: ok {rc=0} 15:47:29.331620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18869): Launched 15:47:29.649074 run osmo-hlr_10.42.42.2(pid=18870): Launched 15:47:29.769709 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:30.324452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18872): Launched 15:47:30.642232 run osmo-stp_10.42.42.5(pid=18873): Launched 15:47:30.762968 run osmo-msc_10.42.42.6: Starting osmo-msc 15:47:31.417636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18875): Launched 15:47:31.746746 run osmo-msc_10.42.42.6(pid=18876): Launched 15:47:32.091860 run osmo-stp_10.42.42.5(pid=18873): ERR: Terminated: ERROR {rc=1} [trial-2361↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18873)] 15:47:32.237646 run osmo-stp_10.42.42.5(pid=18873): stdout: | (launched: 2022-12-09_15:47:30.583367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:32.417530 run osmo-stp_10.42.42.5(pid=18873): stderr: | [0;m[38;5;43m20221209154730776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154730776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154730776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154730776 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154730777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154730777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154730777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:32.553220 run osmo-stp_10.42.42.5(pid=18873): stdout: | (launched: 2022-12-09_15:47:30.583367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:32.679493 run osmo-stp_10.42.42.5(pid=18873): stderr: | [0;m[38;5;43m20221209154730776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154730776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154730776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154730776 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154730777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154730777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154730777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:32.830942 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=18873): Process ended prematurely: osmo-stp_10.42.42.5(pid=18873) [trial-2361↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18873)] [trial-2361↪ussd:oc2g↪assert_extension.py:17] 15:47:32.839786 tst assert_extension.py:17: Test FAILED (6.3 sec) 15:47:32.867536 run osmo-hlr_10.42.42.2(pid=18870): ERR: Terminated: ERROR {rc=237} [trial-2361↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18870)] 15:47:32.917142 run osmo-hlr_10.42.42.2(pid=18870): stdout: | (launched: 2022-12-09_15:47:29.590351) 15:47:32.968501 run osmo-hlr_10.42.42.2(pid=18870): stderr: | [0;m[1;31m20221209154729791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154729791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154729791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154729791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154729791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154729791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154729803 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154729812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154729812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154729812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:33.039681 run osmo-msc_10.42.42.6(pid=18876): ERR: Terminated: ERROR {rc=2} [trial-2361↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18876)] 15:47:33.089147 run osmo-msc_10.42.42.6(pid=18876): stdout: | (launched: 2022-12-09_15:47:31.683185) 15:47:33.140235 run osmo-msc_10.42.42.6(pid=18876): stderr: | [0;m[38;5;43m20221209154732140 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154732140 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f159d5a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154732144 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154732144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154732144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154732145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154732146 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154732147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154732147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154732147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:47:33.191907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18869): Terminating (SIGTERM) 15:47:33.233362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18872): Terminating (SIGTERM) 15:47:33.274945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18875): Terminating (SIGTERM) 15:47:33.316913 --- ParallelTerminationStrategy: PID 18869 died... 15:47:33.336784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18869): Terminated: ok {rc=0} 15:47:33.383098 --- ParallelTerminationStrategy: PID 18872 died... 15:47:33.402593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18872): Terminated: ok {rc=0} 15:47:33.448604 --- ParallelTerminationStrategy: PID 18875 died... 15:47:33.468030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18875): Terminated: ok {rc=0} 15:47:33.555359 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 15:47:34.748138 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:47:34.754863 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 15:47:34.776903 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 15:47:34.804613 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 15:47:34.857261 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 15:47:34.878324 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 15:47:34.906025 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 15:47:35.456291 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 15:47:35.509721 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:35.521242 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:47:35.578235 tst mo_mt_call.py: using LAC 22071 15:47:35.703777 tst mo_mt_call.py: using RAC 141 15:47:35.831173 tst mo_mt_call.py: using CellId 22071 15:47:35.959349 tst mo_mt_call.py: using BVCI 22072 15:47:36.075432 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:36.086941 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:36.098164 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:36.109691 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:36.121214 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:36.132636 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:47:36.248015 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:47:36.368014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:36.865690 run create_hlr_db(pid=18882): Launched 15:47:36.989127 bus /sierra_2: Setting Powered False 15:47:38.052302 run create_hlr_db(pid=18882): Terminated: ok {rc=0} 15:47:38.481352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18884): Launched 15:47:38.781346 run osmo-hlr_10.42.42.2(pid=18885): Launched 15:47:38.894334 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:39.422851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18887): Launched 15:47:39.723278 run osmo-stp_10.42.42.5(pid=18888): Launched 15:47:39.835539 run osmo-msc_10.42.42.6: Starting osmo-msc 15:47:40.376066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18890): Launched 15:47:40.675879 run osmo-msc_10.42.42.6(pid=18891): Launched 15:47:40.842435 run osmo-stp_10.42.42.5(pid=18888): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18888)] 15:47:40.967697 run osmo-stp_10.42.42.5(pid=18888): stdout: | (launched: 2022-12-09_15:47:39.666987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:41.094063 run osmo-stp_10.42.42.5(pid=18888): stderr: | [0;m[38;5;43m20221209154739840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154739840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154739841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154739841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154739842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154739842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154739842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:41.217985 run osmo-stp_10.42.42.5(pid=18888): stdout: | (launched: 2022-12-09_15:47:39.666987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:41.336274 run osmo-stp_10.42.42.5(pid=18888): stderr: | [0;m[38;5;43m20221209154739840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154739840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154739841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154739841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154739842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154739842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154739842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:41.478386 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18888): Process ended prematurely: osmo-stp_10.42.42.5(pid=18888) [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18888)] [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 15:47:41.487046 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 15:47:41.512870 run osmo-hlr_10.42.42.2(pid=18885): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18885)] 15:47:41.559624 run osmo-hlr_10.42.42.2(pid=18885): stdout: | (launched: 2022-12-09_15:47:38.725646) 15:47:41.607918 run osmo-hlr_10.42.42.2(pid=18885): stderr: | [0;m[1;31m20221209154738904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154738904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154738904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154738904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154738904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154738904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154738916 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154738927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154738927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154738927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:41.675132 run osmo-msc_10.42.42.6(pid=18891): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18891)] 15:47:41.721504 run osmo-msc_10.42.42.6(pid=18891): stdout: | (launched: 2022-12-09_15:47:40.620154) 15:47:41.769480 run osmo-msc_10.42.42.6(pid=18891): stderr: | [0;m[38;5;43m20221209154740893 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154740893 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8f44349c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154740893 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154740893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154740893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154740894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154740896 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154740897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154740897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154740897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:47:41.817993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18884): Terminating (SIGTERM) 15:47:41.856437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18887): Terminating (SIGTERM) 15:47:41.895114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18890): Terminating (SIGTERM) 15:47:41.934022 --- ParallelTerminationStrategy: PID 18884 died... 15:47:41.952331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18884): Terminated: ok {rc=0} 15:47:41.995192 --- ParallelTerminationStrategy: PID 18887 died... 15:47:42.014503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18887): Terminated: ok {rc=0} 15:47:42.057066 --- ParallelTerminationStrategy: PID 18890 died... 15:47:42.075139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18890): Terminated: ok {rc=0} 15:47:42.157107 bus /sierra_3: Setting Powered False 15:47:43.251998 bus /sierra_3: Setting Powered False 15:47:44.366216 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 15:47:45.512663 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:45.524836 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:47:45.582851 tst mo_mt_call_osmux.py: using LAC 22072 15:47:45.708030 tst mo_mt_call_osmux.py: using RAC 142 15:47:45.838115 tst mo_mt_call_osmux.py: using CellId 22072 15:47:45.978089 tst mo_mt_call_osmux.py: using BVCI 22073 15:47:46.095658 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:46.107772 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:46.119708 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:46.132346 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:46.144085 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:47:46.155715 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:47:46.277491 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:47:46.422540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:46.910213 run create_hlr_db(pid=18893): Launched 15:47:47.070996 bus /sierra_2: Setting Powered False 15:47:48.131108 run create_hlr_db(pid=18893): Terminated: ok {rc=0} 15:47:48.571584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18895): Launched 15:47:48.893886 run osmo-hlr_10.42.42.2(pid=18896): Launched 15:47:49.017561 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:49.570315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18898): Launched 15:47:49.893622 run osmo-stp_10.42.42.5(pid=18899): Launched 15:47:50.016246 run osmo-msc_10.42.42.6: Starting osmo-msc 15:47:50.597706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18901): Launched 15:47:50.919411 run osmo-msc_10.42.42.6(pid=18902): Launched 15:47:51.097915 run osmo-stp_10.42.42.5(pid=18899): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18899)] 15:47:51.233441 run osmo-stp_10.42.42.5(pid=18899): stdout: | (launched: 2022-12-09_15:47:49.833997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:51.369699 run osmo-stp_10.42.42.5(pid=18899): stderr: | [0;m[38;5;43m20221209154750030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154750030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154750030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154750030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154750031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154750031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154750031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:51.505294 run osmo-stp_10.42.42.5(pid=18899): stdout: | (launched: 2022-12-09_15:47:49.833997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:51.633092 run osmo-stp_10.42.42.5(pid=18899): stderr: | [0;m[38;5;43m20221209154750030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154750030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154750030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154750030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154750031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154750031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154750031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:51.786388 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18899): Process ended prematurely: osmo-stp_10.42.42.5(pid=18899) [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18899)] [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 15:47:51.795533 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:47:51.823474 run osmo-hlr_10.42.42.2(pid=18896): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18896)] 15:47:51.873230 run osmo-hlr_10.42.42.2(pid=18896): stdout: | (launched: 2022-12-09_15:47:48.834250) 15:47:51.924282 run osmo-hlr_10.42.42.2(pid=18896): stderr: | [0;m[1;31m20221209154749034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154749034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154749034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154749034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154749034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154749034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154749047 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154749057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154749057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154749057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:51.995606 run osmo-msc_10.42.42.6(pid=18902): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18902)] 15:47:52.045530 run osmo-msc_10.42.42.6(pid=18902): stdout: | (launched: 2022-12-09_15:47:50.860124) 15:47:52.096627 run osmo-msc_10.42.42.6(pid=18902): stderr: | [0;m[38;5;43m20221209154751182 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154751182 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fda485f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154751182 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154751182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154751183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154751183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154751184 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154751185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154751185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154751185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:47:52.148171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18895): Terminating (SIGTERM) 15:47:52.189440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18898): Terminating (SIGTERM) 15:47:52.230731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18901): Terminating (SIGTERM) 15:47:52.272351 --- ParallelTerminationStrategy: PID 18895 died... 15:47:52.291995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18895): Terminated: ok {rc=0} 15:47:52.338021 --- ParallelTerminationStrategy: PID 18898 died... 15:47:52.357307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18898): Terminated: ok {rc=0} 15:47:52.403058 --- ParallelTerminationStrategy: PID 18901 died... 15:47:52.422251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18901): Terminated: ok {rc=0} 15:47:52.509687 bus /sierra_3: Setting Powered False 15:47:53.607245 bus /sierra_3: Setting Powered False 15:47:54.720562 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 15:47:55.946975 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:47:55.953325 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 15:47:55.973463 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 15:47:56.000411 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 15:47:56.051664 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 15:47:56.071923 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 15:47:56.098297 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 15:47:56.648223 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 15:47:56.695975 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:47:56.707168 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:47:56.762777 tst mo_mt_call.py: using LAC 22073 15:47:56.890128 tst mo_mt_call.py: using RAC 143 15:47:57.014879 tst mo_mt_call.py: using CellId 22073 15:47:57.140337 tst mo_mt_call.py: using BVCI 22074 15:47:57.256614 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:47:57.268115 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:47:57.279341 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:47:57.290815 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:47:57.302211 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:47:57.313679 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:47:57.429671 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:47:57.549120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:58.012732 run create_hlr_db(pid=18907): Launched 15:47:58.136524 bus /sierra_2: Setting Powered False 15:47:59.197187 run create_hlr_db(pid=18907): Terminated: ok {rc=0} 15:47:59.639207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18909): Launched 15:47:59.943713 run osmo-hlr_10.42.42.2(pid=18910): Launched 15:48:00.056665 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:00.582943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18912): Launched 15:48:00.892245 run osmo-stp_10.42.42.5(pid=18913): Launched 15:48:01.023548 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:01.726310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18915): Launched 15:48:02.051400 run osmo-msc_10.42.42.6(pid=18916): Launched 15:48:02.319142 run osmo-stp_10.42.42.5(pid=18913): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18913)] 15:48:02.459268 run osmo-stp_10.42.42.5(pid=18913): stdout: | (launched: 2022-12-09_15:48:00.827038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:02.601455 run osmo-stp_10.42.42.5(pid=18913): stderr: | [0;m[38;5;43m20221209154801161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154801161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154801161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154801162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154801162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154801162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154801162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:02.740476 run osmo-stp_10.42.42.5(pid=18913): stdout: | (launched: 2022-12-09_15:48:00.827038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:02.869409 run osmo-stp_10.42.42.5(pid=18913): stderr: | [0;m[38;5;43m20221209154801161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154801161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154801161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154801162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154801162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154801162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154801162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:03.023658 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18913): Process ended prematurely: osmo-stp_10.42.42.5(pid=18913) [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18913)] [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 15:48:03.033078 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 15:48:03.061530 run osmo-hlr_10.42.42.2(pid=18910): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18910)] 15:48:03.112175 run osmo-hlr_10.42.42.2(pid=18910): stdout: | (launched: 2022-12-09_15:47:59.888012) 15:48:03.164526 run osmo-hlr_10.42.42.2(pid=18910): stderr: | [0;m[1;31m20221209154800066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154800066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154800066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154800066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154800066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154800066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154800078 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154800087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154800087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154800087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:03.237585 run osmo-msc_10.42.42.6(pid=18916): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18916)] 15:48:03.287957 run osmo-msc_10.42.42.6(pid=18916): stdout: | (launched: 2022-12-09_15:48:01.987940) 15:48:03.340030 run osmo-msc_10.42.42.6(pid=18916): stderr: | [0;m[38;5;43m20221209154802457 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154802457 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2ab1966c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154802457 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154802457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154802458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154802458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154802459 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154802460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154802460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154802460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:03.392518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18909): Terminating (SIGTERM) 15:48:03.434428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18912): Terminating (SIGTERM) 15:48:03.476451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18915): Terminating (SIGTERM) 15:48:03.519095 --- ParallelTerminationStrategy: PID 18909 died... 15:48:03.539196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18909): Terminated: ok {rc=0} 15:48:03.586426 --- ParallelTerminationStrategy: PID 18912 died... 15:48:03.605912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18912): Terminated: ok {rc=0} 15:48:03.652924 --- ParallelTerminationStrategy: PID 18915 died... 15:48:03.672785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18915): Terminated: ok {rc=0} 15:48:03.760675 bus /sierra_3: Setting Powered False 15:48:04.858814 bus /sierra_3: Setting Powered False 15:48:05.972202 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 15:48:07.119559 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:07.131600 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:48:07.189615 tst mo_mt_call_osmux.py: using LAC 22074 15:48:07.308776 tst mo_mt_call_osmux.py: using RAC 144 15:48:07.435518 tst mo_mt_call_osmux.py: using CellId 22074 15:48:07.554938 tst mo_mt_call_osmux.py: using BVCI 22075 15:48:07.663791 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:07.674809 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:07.685779 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:07.697209 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:07.708581 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:48:07.719982 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:48:07.838714 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:48:07.959982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:08.459052 run create_hlr_db(pid=18918): Launched 15:48:08.584766 bus /sierra_2: Setting Powered False 15:48:09.648584 run create_hlr_db(pid=18918): Terminated: ok {rc=0} 15:48:10.077682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18920): Launched 15:48:10.377209 run osmo-hlr_10.42.42.2(pid=18921): Launched 15:48:10.491064 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:11.026307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18923): Launched 15:48:11.326930 run osmo-stp_10.42.42.5(pid=18924): Launched 15:48:11.442201 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:11.983085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18926): Launched 15:48:12.282874 run osmo-msc_10.42.42.6(pid=18927): Launched 15:48:12.448525 run osmo-stp_10.42.42.5(pid=18924): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18924)] 15:48:12.573963 run osmo-stp_10.42.42.5(pid=18924): stdout: | (launched: 2022-12-09_15:48:11.270996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:12.701076 run osmo-stp_10.42.42.5(pid=18924): stderr: | [0;m[38;5;43m20221209154811443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154811443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154811443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154811444 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154811444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154811444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154811444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:12.826553 run osmo-stp_10.42.42.5(pid=18924): stdout: | (launched: 2022-12-09_15:48:11.270996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:12.944854 run osmo-stp_10.42.42.5(pid=18924): stderr: | [0;m[38;5;43m20221209154811443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154811443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154811443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154811444 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154811444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154811444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154811444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:13.086872 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18924): Process ended prematurely: osmo-stp_10.42.42.5(pid=18924) [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18924)] [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 15:48:13.095660 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 15:48:13.121615 run osmo-hlr_10.42.42.2(pid=18921): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18921)] 15:48:13.168292 run osmo-hlr_10.42.42.2(pid=18921): stdout: | (launched: 2022-12-09_15:48:10.321460) 15:48:13.216811 run osmo-hlr_10.42.42.2(pid=18921): stderr: | [0;m[1;31m20221209154810498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154810498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154810498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154810498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154810498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154810498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154810511 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154810519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154810520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154810520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:13.284812 run osmo-msc_10.42.42.6(pid=18927): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18927)] 15:48:13.331516 run osmo-msc_10.42.42.6(pid=18927): stdout: | (launched: 2022-12-09_15:48:12.227067) 15:48:13.379918 run osmo-msc_10.42.42.6(pid=18927): stderr: | [0;m[38;5;43m20221209154812502 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154812502 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa39b4fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154812502 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154812502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154812502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154812503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154812504 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154812505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154812505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154812505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:13.428772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18920): Terminating (SIGTERM) 15:48:13.467349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18923): Terminating (SIGTERM) 15:48:13.506047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18926): Terminating (SIGTERM) 15:48:13.545047 --- ParallelTerminationStrategy: PID 18920 died... 15:48:13.563830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18920): Terminated: ok {rc=0} 15:48:13.606956 --- ParallelTerminationStrategy: PID 18923 died... 15:48:13.625402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18923): Terminated: ok {rc=0} 15:48:13.668413 --- ParallelTerminationStrategy: PID 18926 died... 15:48:13.686702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18926): Terminated: ok {rc=0} 15:48:13.770712 bus /sierra_3: Setting Powered False 15:48:14.867667 bus /sierra_3: Setting Powered False 15:48:15.982462 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 15:48:17.231636 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:17.238748 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 15:48:17.260267 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 15:48:17.287854 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 15:48:17.339972 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 15:48:17.361300 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 15:48:17.387750 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 15:48:17.938069 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 15:48:17.986522 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:17.997750 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:48:18.053420 tst mo_mt_call.py: using LAC 22075 15:48:18.172361 tst mo_mt_call.py: using RAC 145 15:48:18.291716 tst mo_mt_call.py: using CellId 22075 15:48:18.411264 tst mo_mt_call.py: using BVCI 22076 15:48:18.519489 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:18.530575 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:18.541473 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:18.552307 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:18.563233 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:18.574271 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:48:18.687940 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:48:18.807857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:19.309386 run create_hlr_db(pid=18932): Launched 15:48:19.432095 bus /sierra_2: Setting Powered False 15:48:20.496404 run create_hlr_db(pid=18932): Terminated: ok {rc=0} 15:48:20.928108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18934): Launched 15:48:21.229716 run osmo-hlr_10.42.42.2(pid=18935): Launched 15:48:21.344164 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:21.873642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18937): Launched 15:48:22.173592 run osmo-stp_10.42.42.5(pid=18938): Launched 15:48:22.286127 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:22.827093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18940): Launched 15:48:23.126903 run osmo-msc_10.42.42.6(pid=18941): Launched 15:48:23.293242 run osmo-stp_10.42.42.5(pid=18938): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18938)] 15:48:23.419031 run osmo-stp_10.42.42.5(pid=18938): stdout: | (launched: 2022-12-09_15:48:22.117590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:23.545105 run osmo-stp_10.42.42.5(pid=18938): stderr: | [0;m[38;5;43m20221209154822287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154822287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154822288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154822288 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154822288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154822289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154822289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:23.669611 run osmo-stp_10.42.42.5(pid=18938): stdout: | (launched: 2022-12-09_15:48:22.117590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:23.788183 run osmo-stp_10.42.42.5(pid=18938): stderr: | [0;m[38;5;43m20221209154822287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154822287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154822288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154822288 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154822288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154822289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154822289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:23.930271 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18938): Process ended prematurely: osmo-stp_10.42.42.5(pid=18938) [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18938)] [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 15:48:23.938953 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 15:48:23.965015 run osmo-hlr_10.42.42.2(pid=18935): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18935)] 15:48:24.011932 run osmo-hlr_10.42.42.2(pid=18935): stdout: | (launched: 2022-12-09_15:48:21.173744) 15:48:24.060523 run osmo-hlr_10.42.42.2(pid=18935): stderr: | [0;m[1;31m20221209154821348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154821348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154821348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154821348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154821349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154821349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154821361 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154821370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154821370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154821370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:24.128260 run osmo-msc_10.42.42.6(pid=18941): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18941)] 15:48:24.174821 run osmo-msc_10.42.42.6(pid=18941): stdout: | (launched: 2022-12-09_15:48:23.071054) 15:48:24.223142 run osmo-msc_10.42.42.6(pid=18941): stderr: | [0;m[38;5;43m20221209154823344 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154823344 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f017ba41c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154823345 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154823345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154823345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154823345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154823347 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154823348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154823348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154823348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:24.272011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18934): Terminating (SIGTERM) 15:48:24.310625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18937): Terminating (SIGTERM) 15:48:24.349782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18940): Terminating (SIGTERM) 15:48:24.389151 --- ParallelTerminationStrategy: PID 18934 died... 15:48:24.407780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18934): Terminated: ok {rc=0} 15:48:24.451254 --- ParallelTerminationStrategy: PID 18937 died... 15:48:24.469571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18937): Terminated: ok {rc=0} 15:48:24.512624 --- ParallelTerminationStrategy: PID 18940 died... 15:48:24.531029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18940): Terminated: ok {rc=0} 15:48:24.615805 bus /sierra_3: Setting Powered False 15:48:25.713893 bus /sierra_3: Setting Powered False 15:48:26.827362 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 15:48:27.972028 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:27.983770 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:48:28.040745 tst mo_mt_call_osmux.py: using LAC 22076 15:48:28.160284 tst mo_mt_call_osmux.py: using RAC 146 15:48:28.278748 tst mo_mt_call_osmux.py: using CellId 22076 15:48:28.397725 tst mo_mt_call_osmux.py: using BVCI 22077 15:48:28.505562 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:28.516629 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:28.527508 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:28.538245 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:28.548930 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:48:28.559796 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:48:28.678198 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:48:28.797241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:29.263020 run create_hlr_db(pid=18943): Launched 15:48:29.385202 bus /sierra_2: Setting Powered False 15:48:30.445124 run create_hlr_db(pid=18943): Terminated: ok {rc=0} 15:48:30.866625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18945): Launched 15:48:31.194876 run osmo-hlr_10.42.42.2(pid=18946): Launched 15:48:31.365221 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:32.103481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18948): Launched 15:48:32.444460 run osmo-stp_10.42.42.5(pid=18949): Launched 15:48:32.580126 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:33.121212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18951): Launched 15:48:33.422891 run osmo-msc_10.42.42.6(pid=18952): Launched 15:48:33.588649 run osmo-stp_10.42.42.5(pid=18949): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18949)] 15:48:33.713979 run osmo-stp_10.42.42.5(pid=18949): stdout: | (launched: 2022-12-09_15:48:32.380687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:33.841252 run osmo-stp_10.42.42.5(pid=18949): stderr: | [0;m[38;5;43m20221209154832584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154832584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154832585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154832585 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154832585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154832586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154832586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:33.966165 run osmo-stp_10.42.42.5(pid=18949): stdout: | (launched: 2022-12-09_15:48:32.380687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:34.085230 run osmo-stp_10.42.42.5(pid=18949): stderr: | [0;m[38;5;43m20221209154832584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154832584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154832585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154832585 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154832585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154832586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154832586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:34.227609 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18949): Process ended prematurely: osmo-stp_10.42.42.5(pid=18949) [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18949)] [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 15:48:34.236458 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:48:34.262442 run osmo-hlr_10.42.42.2(pid=18946): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18946)] 15:48:34.309323 run osmo-hlr_10.42.42.2(pid=18946): stdout: | (launched: 2022-12-09_15:48:31.127168) 15:48:34.357628 run osmo-hlr_10.42.42.2(pid=18946): stderr: | [0;m[1;31m20221209154831553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154831553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154831553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154831554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154831554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154831554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154831574 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154831597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154831598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154831598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:34.425375 run osmo-msc_10.42.42.6(pid=18952): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18952)] 15:48:34.472052 run osmo-msc_10.42.42.6(pid=18952): stdout: | (launched: 2022-12-09_15:48:33.365852) 15:48:34.520479 run osmo-msc_10.42.42.6(pid=18952): stderr: | [0;m[38;5;43m20221209154833642 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154833642 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f20e8d3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154833643 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154833643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154833643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154833643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154833645 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154833645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154833645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154833645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:34.569507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18945): Terminating (SIGTERM) 15:48:34.608233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18948): Terminating (SIGTERM) 15:48:34.647063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18951): Terminating (SIGTERM) 15:48:34.686135 --- ParallelTerminationStrategy: PID 18945 died... 15:48:34.704896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18945): Terminated: ok {rc=0} 15:48:34.748398 --- ParallelTerminationStrategy: PID 18948 died... 15:48:34.767011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18948): Terminated: ok {rc=0} 15:48:34.810163 --- ParallelTerminationStrategy: PID 18951 died... 15:48:34.828444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18951): Terminated: ok {rc=0} 15:48:34.911254 bus /sierra_3: Setting Powered False 15:48:36.010084 bus /sierra_3: Setting Powered False 15:48:37.124194 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 15:48:38.355241 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:38.361459 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 15:48:38.381545 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 15:48:38.407780 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 15:48:38.461125 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 15:48:38.482125 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 15:48:38.509548 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 15:48:39.059155 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 15:48:39.111626 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:39.123230 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:48:39.180583 tst mo_mt_call.py: using LAC 22077 15:48:39.310414 tst mo_mt_call.py: using RAC 147 15:48:39.434242 tst mo_mt_call.py: using CellId 22077 15:48:39.561309 tst mo_mt_call.py: using BVCI 22078 15:48:39.679791 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:39.691610 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:39.703094 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:39.714910 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:39.726782 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:39.738691 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:48:39.858660 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:48:39.976681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:40.441624 run create_hlr_db(pid=18957): Launched 15:48:40.563658 bus /sierra_2: Setting Powered False 15:48:41.624418 run create_hlr_db(pid=18957): Terminated: ok {rc=0} 15:48:42.043204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18959): Launched 15:48:42.343473 run osmo-hlr_10.42.42.2(pid=18960): Launched 15:48:42.457131 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:42.990197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18962): Launched 15:48:43.289318 run osmo-stp_10.42.42.5(pid=18963): Launched 15:48:43.402919 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:43.944782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18965): Launched 15:48:44.246015 run osmo-msc_10.42.42.6(pid=18966): Launched 15:48:44.411868 run osmo-stp_10.42.42.5(pid=18963): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18963)] 15:48:44.537952 run osmo-stp_10.42.42.5(pid=18963): stdout: | (launched: 2022-12-09_15:48:43.233415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:44.664882 run osmo-stp_10.42.42.5(pid=18963): stderr: | [0;m[38;5;43m20221209154843405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154843405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154843405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154843405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154843406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154843406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154843406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:44.789581 run osmo-stp_10.42.42.5(pid=18963): stdout: | (launched: 2022-12-09_15:48:43.233415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:44.908800 run osmo-stp_10.42.42.5(pid=18963): stderr: | [0;m[38;5;43m20221209154843405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154843405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154843405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154843405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154843406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154843406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154843406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:45.050723 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18963): Process ended prematurely: osmo-stp_10.42.42.5(pid=18963) [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18963)] [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 15:48:45.059357 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 15:48:45.085202 run osmo-hlr_10.42.42.2(pid=18960): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18960)] 15:48:45.132176 run osmo-hlr_10.42.42.2(pid=18960): stdout: | (launched: 2022-12-09_15:48:42.287401) 15:48:45.180873 run osmo-hlr_10.42.42.2(pid=18960): stderr: | [0;m[1;31m20221209154842464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154842464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154842464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154842464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154842464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154842464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154842476 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154842485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154842485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154842485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:45.249110 run osmo-msc_10.42.42.6(pid=18966): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18966)] 15:48:45.295996 run osmo-msc_10.42.42.6(pid=18966): stdout: | (launched: 2022-12-09_15:48:44.189275) 15:48:45.344476 run osmo-msc_10.42.42.6(pid=18966): stderr: | [0;m[38;5;43m20221209154844462 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154844463 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1ceb3c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154844463 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154844463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154844464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154844464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154844466 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154844466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154844466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154844466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:45.393633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18959): Terminating (SIGTERM) 15:48:45.432509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18962): Terminating (SIGTERM) 15:48:45.471280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18965): Terminating (SIGTERM) 15:48:45.510757 --- ParallelTerminationStrategy: PID 18959 died... 15:48:45.529648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18959): Terminated: ok {rc=0} 15:48:45.573265 --- ParallelTerminationStrategy: PID 18962 died... 15:48:45.591727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18962): Terminated: ok {rc=0} 15:48:45.635069 --- ParallelTerminationStrategy: PID 18965 died... 15:48:45.653567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18965): Terminated: ok {rc=0} 15:48:45.737550 bus /sierra_3: Setting Powered False 15:48:46.837269 bus /sierra_3: Setting Powered False 15:48:47.950708 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 15:48:49.098695 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:49.110766 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:48:49.168518 tst mo_mt_call_osmux.py: using LAC 22078 15:48:49.294933 tst mo_mt_call_osmux.py: using RAC 148 15:48:49.419367 tst mo_mt_call_osmux.py: using CellId 22078 15:48:49.544179 tst mo_mt_call_osmux.py: using BVCI 22079 15:48:49.662162 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:49.673723 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:49.685301 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:49.696897 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:49.708444 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:48:49.719986 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:48:49.839384 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:48:49.956117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:50.421734 run create_hlr_db(pid=18968): Launched 15:48:50.543666 bus /sierra_2: Setting Powered False 15:48:51.603036 run create_hlr_db(pid=18968): Terminated: ok {rc=0} 15:48:52.044215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18970): Launched 15:48:52.368166 run osmo-hlr_10.42.42.2(pid=18971): Launched 15:48:52.493407 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:53.050344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18973): Launched 15:48:53.372785 run osmo-stp_10.42.42.5(pid=18974): Launched 15:48:53.495245 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:54.078463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18976): Launched 15:48:54.402631 run osmo-msc_10.42.42.6(pid=18977): Launched 15:48:54.583236 run osmo-stp_10.42.42.5(pid=18974): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18974)] 15:48:54.718762 run osmo-stp_10.42.42.5(pid=18974): stdout: | (launched: 2022-12-09_15:48:53.313183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:54.854937 run osmo-stp_10.42.42.5(pid=18974): stderr: | [0;m[38;5;43m20221209154853507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154853507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154853507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154853508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154853508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154853508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154853508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:54.991241 run osmo-stp_10.42.42.5(pid=18974): stdout: | (launched: 2022-12-09_15:48:53.313183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:55.119241 run osmo-stp_10.42.42.5(pid=18974): stderr: | [0;m[38;5;43m20221209154853507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154853507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154853507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154853508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154853508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154853508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154853508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:55.272188 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18974): Process ended prematurely: osmo-stp_10.42.42.5(pid=18974) [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18974)] [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 15:48:55.281775 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:48:55.309656 run osmo-hlr_10.42.42.2(pid=18971): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18971)] 15:48:55.359368 run osmo-hlr_10.42.42.2(pid=18971): stdout: | (launched: 2022-12-09_15:48:52.308291) 15:48:55.410496 run osmo-hlr_10.42.42.2(pid=18971): stderr: | [0;m[1;31m20221209154852507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154852507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154852507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154852507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154852507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154852507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154852520 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154852528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154852528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154852528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:55.481787 run osmo-msc_10.42.42.6(pid=18977): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18977)] 15:48:55.531814 run osmo-msc_10.42.42.6(pid=18977): stdout: | (launched: 2022-12-09_15:48:54.342630) 15:48:55.583404 run osmo-msc_10.42.42.6(pid=18977): stderr: | [0;m[38;5;43m20221209154854665 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154854666 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fae861aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154854666 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154854666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154854666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154854666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154854668 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154854668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154854668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154854668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:55.635183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18970): Terminating (SIGTERM) 15:48:55.676633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18973): Terminating (SIGTERM) 15:48:55.718147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18976): Terminating (SIGTERM) 15:48:55.759899 --- ParallelTerminationStrategy: PID 18970 died... 15:48:55.779692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18970): Terminated: ok {rc=0} 15:48:55.826538 --- ParallelTerminationStrategy: PID 18973 died... 15:48:55.845991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18973): Terminated: ok {rc=0} 15:48:55.892103 --- ParallelTerminationStrategy: PID 18976 died... 15:48:55.911279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18976): Terminated: ok {rc=0} 15:48:55.998323 bus /sierra_3: Setting Powered False 15:48:57.095722 bus /sierra_3: Setting Powered False 15:48:58.209928 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 15:48:59.442350 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:59.449294 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 15:48:59.470620 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 15:48:59.497938 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 15:48:59.551351 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 15:48:59.572283 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 15:48:59.599915 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 15:49:00.151001 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 15:49:00.202939 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:00.214495 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:49:00.271307 tst mo_mt_call.py: using LAC 22079 15:49:00.398919 tst mo_mt_call.py: using RAC 149 15:49:00.523540 tst mo_mt_call.py: using CellId 22079 15:49:00.649127 tst mo_mt_call.py: using BVCI 22080 15:49:00.765480 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:00.776881 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:00.788125 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:00.799624 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:00.810873 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:00.823459 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:49:00.981026 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:49:01.127326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:01.687523 run create_hlr_db(pid=18982): Launched 15:49:01.815707 bus /sierra_2: Setting Powered False 15:49:02.879356 run create_hlr_db(pid=18982): Terminated: ok {rc=0} 15:49:03.309883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18984): Launched 15:49:03.610921 run osmo-hlr_10.42.42.2(pid=18985): Launched 15:49:03.724298 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:04.241157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18987): Launched 15:49:04.543044 run osmo-stp_10.42.42.5(pid=18988): Launched 15:49:04.656165 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:05.199248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18990): Launched 15:49:05.500152 run osmo-msc_10.42.42.6(pid=18991): Launched 15:49:05.667710 run osmo-stp_10.42.42.5(pid=18988): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18988)] 15:49:05.793492 run osmo-stp_10.42.42.5(pid=18988): stdout: | (launched: 2022-12-09_15:49:04.486938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:05.919798 run osmo-stp_10.42.42.5(pid=18988): stderr: | [0;m[38;5;43m20221209154904660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154904661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154904661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154904661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154904662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154904662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154904662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:06.044600 run osmo-stp_10.42.42.5(pid=18988): stdout: | (launched: 2022-12-09_15:49:04.486938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:06.163627 run osmo-stp_10.42.42.5(pid=18988): stderr: | [0;m[38;5;43m20221209154904660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154904661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154904661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154904661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154904662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154904662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154904662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:06.306285 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18988): Process ended prematurely: osmo-stp_10.42.42.5(pid=18988) [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18988)] [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 15:49:06.315122 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:49:06.341539 run osmo-hlr_10.42.42.2(pid=18985): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18985)] 15:49:06.389160 run osmo-hlr_10.42.42.2(pid=18985): stdout: | (launched: 2022-12-09_15:49:03.554553) 15:49:06.438111 run osmo-hlr_10.42.42.2(pid=18985): stderr: | [0;m[1;31m20221209154903733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154903733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154903733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154903733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154903733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154903733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154903745 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154903755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154903755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154903755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:06.506574 run osmo-msc_10.42.42.6(pid=18991): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18991)] 15:49:06.554213 run osmo-msc_10.42.42.6(pid=18991): stdout: | (launched: 2022-12-09_15:49:05.443991) 15:49:06.603139 run osmo-msc_10.42.42.6(pid=18991): stderr: | [0;m[38;5;43m20221209154905716 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154905717 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbca9fd9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154905717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154905717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154905717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154905717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154905719 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154905719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154905719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154905720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:06.652378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18984): Terminating (SIGTERM) 15:49:06.691693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18987): Terminating (SIGTERM) 15:49:06.730948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18990): Terminating (SIGTERM) 15:49:06.770991 --- ParallelTerminationStrategy: PID 18984 died... 15:49:06.790018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18984): Terminated: ok {rc=0} 15:49:06.834242 --- ParallelTerminationStrategy: PID 18987 died... 15:49:06.852908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18987): Terminated: ok {rc=0} 15:49:06.896746 --- ParallelTerminationStrategy: PID 18990 died... 15:49:06.915321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18990): Terminated: ok {rc=0} 15:49:07.000277 bus /sierra_3: Setting Powered False 15:49:08.099971 bus /sierra_3: Setting Powered False 15:49:09.213713 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 15:49:10.361263 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:10.373385 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:49:10.430532 tst mo_mt_call_osmux.py: using LAC 22080 15:49:10.556667 tst mo_mt_call_osmux.py: using RAC 150 15:49:10.674828 tst mo_mt_call_osmux.py: using CellId 22080 15:49:10.794288 tst mo_mt_call_osmux.py: using BVCI 22081 15:49:10.903817 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:10.915029 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:10.926098 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:10.937047 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:10.947983 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:49:10.958987 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:49:11.072228 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:49:11.192331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:11.660187 run create_hlr_db(pid=18993): Launched 15:49:11.782023 bus /sierra_2: Setting Powered False 15:49:12.841903 run create_hlr_db(pid=18993): Terminated: ok {rc=0} 15:49:13.261889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18996): Launched 15:49:13.562121 run osmo-hlr_10.42.42.2(pid=18997): Launched 15:49:13.674466 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:14.209460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18999): Launched 15:49:14.508258 run osmo-stp_10.42.42.5(pid=19000): Launched 15:49:14.621268 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:15.162393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19002): Launched 15:49:15.463313 run osmo-msc_10.42.42.6(pid=19003): Launched 15:49:15.629706 run osmo-stp_10.42.42.5(pid=19000): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19000)] 15:49:15.755613 run osmo-stp_10.42.42.5(pid=19000): stdout: | (launched: 2022-12-09_15:49:14.452485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:15.915119 run osmo-stp_10.42.42.5(pid=19000): stderr: | [0;m[38;5;43m20221209154914625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154914625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154914625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154914626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154914626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154914626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154914626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:16.055709 run osmo-stp_10.42.42.5(pid=19000): stdout: | (launched: 2022-12-09_15:49:14.452485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:16.189641 run osmo-stp_10.42.42.5(pid=19000): stderr: | [0;m[38;5;43m20221209154914625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154914625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154914625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154914626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154914626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154914626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154914626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:16.349719 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19000): Process ended prematurely: osmo-stp_10.42.42.5(pid=19000) [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19000)] [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 15:49:16.360093 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 15:49:16.391386 run osmo-hlr_10.42.42.2(pid=18997): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18997)] 15:49:16.445408 run osmo-hlr_10.42.42.2(pid=18997): stdout: | (launched: 2022-12-09_15:49:13.505571) 15:49:16.499264 run osmo-hlr_10.42.42.2(pid=18997): stderr: | [0;m[1;31m20221209154913685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154913685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154913685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154913686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154913686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154913686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154913698 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154913706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154913707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154913707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:16.575114 run osmo-msc_10.42.42.6(pid=19003): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19003)] 15:49:16.628553 run osmo-msc_10.42.42.6(pid=19003): stdout: | (launched: 2022-12-09_15:49:15.406790) 15:49:16.682729 run osmo-msc_10.42.42.6(pid=19003): stderr: | [0;m[38;5;43m20221209154915681 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154915681 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feef29b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154915681 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154915681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154915682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154915682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154915683 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154915684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154915684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154915684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:16.737698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18996): Terminating (SIGTERM) 15:49:16.782902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18999): Terminating (SIGTERM) 15:49:16.828783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19002): Terminating (SIGTERM) 15:49:16.875086 --- ParallelTerminationStrategy: PID 18996 died... 15:49:16.895764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18996): Terminated: ok {rc=0} 15:49:16.946794 --- ParallelTerminationStrategy: PID 18999 died... 15:49:16.967156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18999): Terminated: ok {rc=0} 15:49:17.018496 --- ParallelTerminationStrategy: PID 19002 died... 15:49:17.038817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19002): Terminated: ok {rc=0} 15:49:17.130816 bus /sierra_3: Setting Powered False 15:49:18.228703 bus /sierra_3: Setting Powered False 15:49:19.342542 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:49:20.576675 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:49:20.582713 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:49:20.602744 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 15:49:20.628852 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:49:20.680021 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:49:20.700209 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 15:49:20.726357 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:49:21.276716 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 15:49:21.324396 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:21.335447 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:49:21.395680 tst mo_mt_call.py: using LAC 22081 15:49:21.512937 tst mo_mt_call.py: using RAC 151 15:49:21.627864 tst mo_mt_call.py: using CellId 22081 15:49:21.742398 tst mo_mt_call.py: using BVCI 22082 15:49:21.849969 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:21.860901 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:21.871699 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:21.882454 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:21.893224 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:21.903949 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:49:22.022864 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:49:22.139202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:22.602509 run create_hlr_db(pid=19008): Launched 15:49:22.724491 bus /sierra_2: Setting Powered False 15:49:23.784682 run create_hlr_db(pid=19008): Terminated: ok {rc=0} 15:49:24.203446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19010): Launched 15:49:24.503640 run osmo-hlr_10.42.42.2(pid=19011): Launched 15:49:24.616490 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:25.142922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19013): Launched 15:49:25.444630 run osmo-stp_10.42.42.5(pid=19014): Launched 15:49:25.558205 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:26.099827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19016): Launched 15:49:26.400389 run osmo-msc_10.42.42.6(pid=19017): Launched 15:49:26.567460 run osmo-stp_10.42.42.5(pid=19014): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19014)] 15:49:26.692812 run osmo-stp_10.42.42.5(pid=19014): stdout: | (launched: 2022-12-09_15:49:25.388028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:26.819386 run osmo-stp_10.42.42.5(pid=19014): stderr: | [0;m[38;5;43m20221209154925559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154925559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154925560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154925560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154925562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154925562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154925563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:26.944272 run osmo-stp_10.42.42.5(pid=19014): stdout: | (launched: 2022-12-09_15:49:25.388028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:27.063271 run osmo-stp_10.42.42.5(pid=19014): stderr: | [0;m[38;5;43m20221209154925559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154925559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154925560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154925560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154925562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154925562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154925563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:27.206770 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19014): Process ended prematurely: osmo-stp_10.42.42.5(pid=19014) [trial-2361↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19014)] [trial-2361↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 15:49:27.215454 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 15:49:27.241522 run osmo-hlr_10.42.42.2(pid=19011): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19011)] 15:49:27.288484 run osmo-hlr_10.42.42.2(pid=19011): stdout: | (launched: 2022-12-09_15:49:24.447779) 15:49:27.337158 run osmo-hlr_10.42.42.2(pid=19011): stderr: | [0;m[1;31m20221209154924627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154924627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154924627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154924627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154924627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154924627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154924639 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154924648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154924648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154924648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:27.405060 run osmo-msc_10.42.42.6(pid=19017): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19017)] 15:49:27.451716 run osmo-msc_10.42.42.6(pid=19017): stdout: | (launched: 2022-12-09_15:49:26.344091) 15:49:27.500520 run osmo-msc_10.42.42.6(pid=19017): stderr: | [0;m[38;5;43m20221209154926620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154926620 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0d87586c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154926620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154926620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154926620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154926620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154926622 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154926623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154926623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154926623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:27.549200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19010): Terminating (SIGTERM) 15:49:27.588056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19013): Terminating (SIGTERM) 15:49:27.626663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19016): Terminating (SIGTERM) 15:49:27.665631 --- ParallelTerminationStrategy: PID 19010 died... 15:49:27.684262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19010): Terminated: ok {rc=0} 15:49:27.728045 --- ParallelTerminationStrategy: PID 19013 died... 15:49:27.746310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19013): Terminated: ok {rc=0} 15:49:27.789440 --- ParallelTerminationStrategy: PID 19016 died... 15:49:27.807549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19016): Terminated: ok {rc=0} 15:49:27.891311 bus /sierra_3: Setting Powered False 15:49:28.991365 bus /sierra_3: Setting Powered False 15:49:30.107613 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 15:49:31.265568 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:31.281107 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:49:31.349265 tst mo_mt_call_osmux.py: using LAC 22082 15:49:31.476831 tst mo_mt_call_osmux.py: using RAC 152 15:49:31.634691 tst mo_mt_call_osmux.py: using CellId 22082 15:49:31.796893 tst mo_mt_call_osmux.py: using BVCI 22083 15:49:31.938539 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:31.951015 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:31.963536 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:31.979171 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:31.991843 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:49:32.007070 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:49:32.152850 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:49:32.279340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:32.783387 run create_hlr_db(pid=19019): Launched 15:49:32.907008 bus /sierra_2: Setting Powered False 15:49:33.970416 run create_hlr_db(pid=19019): Terminated: ok {rc=0} 15:49:34.420690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19021): Launched 15:49:34.745551 run osmo-hlr_10.42.42.2(pid=19022): Launched 15:49:34.868808 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:35.427724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19024): Launched 15:49:35.753478 run osmo-stp_10.42.42.5(pid=19025): Launched 15:49:35.876612 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:36.460160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19027): Launched 15:49:36.785139 run osmo-msc_10.42.42.6(pid=19028): Launched 15:49:36.965263 run osmo-stp_10.42.42.5(pid=19025): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19025)] 15:49:37.100734 run osmo-stp_10.42.42.5(pid=19025): stdout: | (launched: 2022-12-09_15:49:35.692765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:37.237434 run osmo-stp_10.42.42.5(pid=19025): stderr: | [0;m[38;5;43m20221209154935886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154935886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154935886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154935887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154935887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154935887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154935887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:37.373644 run osmo-stp_10.42.42.5(pid=19025): stdout: | (launched: 2022-12-09_15:49:35.692765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:37.502289 run osmo-stp_10.42.42.5(pid=19025): stderr: | [0;m[38;5;43m20221209154935886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154935886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154935886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154935887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154935887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154935887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154935887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:37.656364 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19025): Process ended prematurely: osmo-stp_10.42.42.5(pid=19025) [trial-2361↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19025)] [trial-2361↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 15:49:37.665937 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 15:49:37.693910 run osmo-hlr_10.42.42.2(pid=19022): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19022)] 15:49:37.743791 run osmo-hlr_10.42.42.2(pid=19022): stdout: | (launched: 2022-12-09_15:49:34.685827) 15:49:37.795438 run osmo-hlr_10.42.42.2(pid=19022): stderr: | [0;m[1;31m20221209154934883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154934883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154934883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154934883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154934883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154934883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154934898 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154934909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154934909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154934909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:37.867331 run osmo-msc_10.42.42.6(pid=19028): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19028)] 15:49:37.917227 run osmo-msc_10.42.42.6(pid=19028): stdout: | (launched: 2022-12-09_15:49:36.725404) 15:49:37.968268 run osmo-msc_10.42.42.6(pid=19028): stderr: | [0;m[38;5;43m20221209154937048 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154937048 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f65be9e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154937048 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154937049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154937049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154937049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154937051 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154937051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154937051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154937051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:38.019750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19021): Terminating (SIGTERM) 15:49:38.061265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19024): Terminating (SIGTERM) 15:49:38.102789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19027): Terminating (SIGTERM) 15:49:38.144421 --- ParallelTerminationStrategy: PID 19021 died... 15:49:38.164328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19021): Terminated: ok {rc=0} 15:49:38.210559 --- ParallelTerminationStrategy: PID 19024 died... 15:49:38.230019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19024): Terminated: ok {rc=0} 15:49:38.276103 --- ParallelTerminationStrategy: PID 19027 died... 15:49:38.295494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19027): Terminated: ok {rc=0} 15:49:38.382497 bus /sierra_3: Setting Powered False 15:49:39.481567 bus /sierra_3: Setting Powered False 15:49:40.594537 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:49:41.828729 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:49:41.834815 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:49:41.856072 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 15:49:41.883465 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 15:49:41.937257 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:49:41.958424 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 15:49:41.985967 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 15:49:42.534744 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 15:49:42.587397 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:42.598920 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:49:42.666453 tst mo_mt_call.py: using LAC 22083 15:49:42.800037 tst mo_mt_call.py: using RAC 153 15:49:42.926484 tst mo_mt_call.py: using CellId 22083 15:49:43.051311 tst mo_mt_call.py: using BVCI 22084 15:49:43.169275 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:43.180565 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:43.191631 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:43.202874 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:43.214226 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:43.225548 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:49:43.344591 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:49:43.463886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:43.963885 run create_hlr_db(pid=19033): Launched 15:49:44.087989 bus /sierra_2: Setting Powered False 15:49:45.151809 run create_hlr_db(pid=19033): Terminated: ok {rc=0} 15:49:45.582997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19035): Launched 15:49:45.901632 run osmo-hlr_10.42.42.2(pid=19036): Launched 15:49:46.098733 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:46.911187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19038): Launched 15:49:47.259972 run osmo-stp_10.42.42.5(pid=19039): Launched 15:49:47.451466 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:48.039604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19041): Launched 15:49:48.364560 run osmo-msc_10.42.42.6(pid=19042): Launched 15:49:48.544401 run osmo-stp_10.42.42.5(pid=19039): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19039)] 15:49:48.681639 run osmo-stp_10.42.42.5(pid=19039): stdout: | (launched: 2022-12-09_15:49:47.194172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:48.818351 run osmo-stp_10.42.42.5(pid=19039): stderr: | [0;m[38;5;43m20221209154947469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154947469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154947469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154947469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154947470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154947470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154947470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:48.953697 run osmo-stp_10.42.42.5(pid=19039): stdout: | (launched: 2022-12-09_15:49:47.194172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:49.082209 run osmo-stp_10.42.42.5(pid=19039): stderr: | [0;m[38;5;43m20221209154947469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154947469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154947469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154947469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154947470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154947470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154947470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:49.236412 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19039): Process ended prematurely: osmo-stp_10.42.42.5(pid=19039) [trial-2361↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19039)] [trial-2361↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 15:49:49.246043 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 15:49:49.274326 run osmo-hlr_10.42.42.2(pid=19036): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19036)] 15:49:49.324423 run osmo-hlr_10.42.42.2(pid=19036): stdout: | (launched: 2022-12-09_15:49:45.828362) 15:49:49.375904 run osmo-hlr_10.42.42.2(pid=19036): stderr: | [0;m[1;31m20221209154946188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154946188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154946188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154946188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154946188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154946188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154946205 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154946232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154946233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154946235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:49.447513 run osmo-msc_10.42.42.6(pid=19042): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19042)] 15:49:49.497138 run osmo-msc_10.42.42.6(pid=19042): stdout: | (launched: 2022-12-09_15:49:48.304229) 15:49:49.548462 run osmo-msc_10.42.42.6(pid=19042): stderr: | [0;m[38;5;43m20221209154948629 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154948629 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f87aeeb1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154948629 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154948629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154948630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154948630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154948631 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154948632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154948632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154948632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:49.600510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19035): Terminating (SIGTERM) 15:49:49.641848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19038): Terminating (SIGTERM) 15:49:49.683221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19041): Terminating (SIGTERM) 15:49:49.725340 --- ParallelTerminationStrategy: PID 19035 died... 15:49:49.745336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19035): Terminated: ok {rc=0} 15:49:49.791438 --- ParallelTerminationStrategy: PID 19038 died... 15:49:49.810909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19038): Terminated: ok {rc=0} 15:49:49.857520 --- ParallelTerminationStrategy: PID 19041 died... 15:49:49.877184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19041): Terminated: ok {rc=0} 15:49:49.965058 bus /sierra_3: Setting Powered False 15:49:51.064118 bus /sierra_3: Setting Powered False 15:49:52.179932 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 15:49:53.326340 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:53.337935 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:49:53.394158 tst mo_mt_call_osmux.py: using LAC 22084 15:49:53.523648 tst mo_mt_call_osmux.py: using RAC 154 15:49:53.649307 tst mo_mt_call_osmux.py: using CellId 22084 15:49:53.774863 tst mo_mt_call_osmux.py: using BVCI 22085 15:49:53.891430 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:53.902978 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:53.914170 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:53.925684 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:53.937203 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:49:53.948554 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:49:54.065466 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:49:54.180456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:54.645311 run create_hlr_db(pid=19044): Launched 15:49:54.768358 bus /sierra_2: Setting Powered False 15:49:55.828687 run create_hlr_db(pid=19044): Terminated: ok {rc=0} 15:49:56.269708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19046): Launched 15:49:56.595040 run osmo-hlr_10.42.42.2(pid=19047): Launched 15:49:56.718483 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:57.276797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19049): Launched 15:49:57.600605 run osmo-stp_10.42.42.5(pid=19050): Launched 15:49:57.722923 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:58.309609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19052): Launched 15:49:58.632932 run osmo-msc_10.42.42.6(pid=19053): Launched 15:49:58.811763 run osmo-stp_10.42.42.5(pid=19050): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19050)] 15:49:58.947578 run osmo-stp_10.42.42.5(pid=19050): stdout: | (launched: 2022-12-09_15:49:57.540181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:59.084751 run osmo-stp_10.42.42.5(pid=19050): stderr: | [0;m[38;5;43m20221209154957733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154957733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154957733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154957734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154957736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154957736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154957736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:59.220701 run osmo-stp_10.42.42.5(pid=19050): stdout: | (launched: 2022-12-09_15:49:57.540181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:59.349353 run osmo-stp_10.42.42.5(pid=19050): stderr: | [0;m[38;5;43m20221209154957733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209154957733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209154957733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209154957734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209154957736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209154957736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209154957736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:59.503233 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19050): Process ended prematurely: osmo-stp_10.42.42.5(pid=19050) [trial-2361↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19050)] [trial-2361↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 15:49:59.512676 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:49:59.540836 run osmo-hlr_10.42.42.2(pid=19047): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19047)] 15:49:59.590847 run osmo-hlr_10.42.42.2(pid=19047): stdout: | (launched: 2022-12-09_15:49:56.534971) 15:49:59.642546 run osmo-hlr_10.42.42.2(pid=19047): stderr: | [0;m[1;31m20221209154956736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209154956736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209154956736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209154956736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209154956736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209154956736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209154956748 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209154956757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209154956757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209154956757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:59.714328 run osmo-msc_10.42.42.6(pid=19053): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19053)] 15:49:59.764030 run osmo-msc_10.42.42.6(pid=19053): stdout: | (launched: 2022-12-09_15:49:58.573088) 15:49:59.815516 run osmo-msc_10.42.42.6(pid=19053): stderr: | [0;m[38;5;43m20221209154958896 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209154958896 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f985cfb8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209154958896 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209154958896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209154958896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209154958896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209154958898 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209154958898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209154958899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209154958899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:59.867457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19046): Terminating (SIGTERM) 15:49:59.908528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19049): Terminating (SIGTERM) 15:49:59.949802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19052): Terminating (SIGTERM) 15:49:59.991211 --- ParallelTerminationStrategy: PID 19046 died... 15:50:00.010979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19046): Terminated: ok {rc=0} 15:50:00.057160 --- ParallelTerminationStrategy: PID 19049 died... 15:50:00.076570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19049): Terminated: ok {rc=0} 15:50:00.122340 --- ParallelTerminationStrategy: PID 19052 died... 15:50:00.141748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19052): Terminated: ok {rc=0} 15:50:00.227630 bus /sierra_3: Setting Powered False 15:50:01.346288 bus /sierra_3: Setting Powered False 15:50:02.477297 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 emergency:oc2g --------------------------------------------------------------------- 15:50:03.708610 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:50:03.713339 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 15:50:03.733993 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 15:50:03.760249 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 15:50:03.843404 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 15:50:03.863855 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 15:50:03.890405 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 15:50:04.471914 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2361 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 15:50:04.477069 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:04.487573 tst emergency:oc2g: Using 1 x bts (candidates: 1) 15:50:04.523103 tst emergency_mo_mt_call.py: using LAC 22085 15:50:04.637772 tst emergency_mo_mt_call.py: using RAC 155 15:50:04.751334 tst emergency_mo_mt_call.py: using CellId 22085 15:50:04.864873 tst emergency_mo_mt_call.py: using BVCI 22086 15:50:04.969964 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:04.980371 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:04.990689 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:05.001098 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:05.011490 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:05.021858 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:50:05.138247 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:50:05.256671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:05.749412 run create_hlr_db(pid=19061): Launched 15:50:05.869814 bus /sierra_2: Setting Powered False 15:50:06.932407 run create_hlr_db(pid=19061): Terminated: ok {rc=0} 15:50:07.374902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19063): Launched 15:50:07.692775 run osmo-hlr_10.42.42.2(pid=19064): Launched 15:50:07.814050 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:08.363536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19066): Launched 15:50:08.682347 run osmo-stp_10.42.42.5(pid=19067): Launched 15:50:08.813168 tst emergency_mo_mt_call.py: using MSISDN 7259 15:50:08.971795 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:09.540002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19069): Launched 15:50:09.858085 run osmo-msc_10.42.42.6(pid=19070): Launched 15:50:10.034046 run osmo-stp_10.42.42.5(pid=19067): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19067)] 15:50:10.167471 run osmo-stp_10.42.42.5(pid=19067): stdout: | (launched: 2022-12-09_15:50:08.623503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:10.301446 run osmo-stp_10.42.42.5(pid=19067): stderr: | [0;m[38;5;43m20221209155008815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155008815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155008815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155008816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155008816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155008816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155008816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:10.434944 run osmo-stp_10.42.42.5(pid=19067): stdout: | (launched: 2022-12-09_15:50:08.623503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:10.562269 run osmo-stp_10.42.42.5(pid=19067): stderr: | [0;m[38;5;43m20221209155008815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155008815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155008815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155008816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155008816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155008816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155008816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:10.713807 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=19067): Process ended prematurely: osmo-stp_10.42.42.5(pid=19067) [trial-2361↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19067)] [trial-2361↪emergency:oc2g↪emergency_mo_mt_call.py:19] 15:50:10.722568 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 15:50:10.749936 run osmo-hlr_10.42.42.2(pid=19064): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19064)] 15:50:10.799851 run osmo-hlr_10.42.42.2(pid=19064): stdout: | (launched: 2022-12-09_15:50:07.634198) 15:50:10.851267 run osmo-hlr_10.42.42.2(pid=19064): stderr: | [0;m[1;31m20221209155007832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155007832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155007832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155007832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155007832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155007832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155007843 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155007852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155007852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155007852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:10.922703 run osmo-msc_10.42.42.6(pid=19070): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19070)] 15:50:10.972334 run osmo-msc_10.42.42.6(pid=19070): stdout: | (launched: 2022-12-09_15:50:09.799148) 15:50:11.023539 run osmo-msc_10.42.42.6(pid=19070): stderr: | [0;m[38;5;43m20221209155010120 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155010120 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4b3d7fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155010120 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155010120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155010120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155010121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155010122 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155010123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155010123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155010123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:11.075326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19063): Terminating (SIGTERM) 15:50:11.116626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19066): Terminating (SIGTERM) 15:50:11.158102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19069): Terminating (SIGTERM) 15:50:11.199965 --- ParallelTerminationStrategy: PID 19063 died... 15:50:11.219842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19063): Terminated: ok {rc=0} 15:50:11.266189 --- ParallelTerminationStrategy: PID 19066 died... 15:50:11.285651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19066): Terminated: ok {rc=0} 15:50:11.331789 --- ParallelTerminationStrategy: PID 19069 died... 15:50:11.351278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19069): Terminated: ok {rc=0} 15:50:11.438403 bus /sierra_3: Setting Powered False 15:50:12.533291 bus /sierra_3: Setting Powered False 15:50:13.647020 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 15:50:14.734050 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:14.746018 tst emergency:oc2g: Using 1 x bts (candidates: 1) 15:50:14.784336 tst emergency_preemptive_call.py: using LAC 22086 15:50:14.909184 tst emergency_preemptive_call.py: using RAC 156 15:50:15.033798 tst emergency_preemptive_call.py: using CellId 22086 15:50:15.158861 tst emergency_preemptive_call.py: using BVCI 22087 15:50:15.273279 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:15.284104 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:15.294961 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:15.306177 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:15.317275 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:50:15.328145 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:50:15.442237 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:50:15.561456 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:50:15.675757 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:50:15.790064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:16.337579 run create_hlr_db(pid=19072): Launched 15:50:16.492486 bus /sierra_2: Setting Powered False 15:50:17.551933 run create_hlr_db(pid=19072): Terminated: ok {rc=0} 15:50:17.988042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19074): Launched 15:50:18.308938 run osmo-hlr_10.42.42.2(pid=19075): Launched 15:50:18.429993 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:18.980262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19077): Launched 15:50:19.299043 run osmo-stp_10.42.42.5(pid=19078): Launched 15:50:19.429717 tst emergency_preemptive_call.py: using MSISDN 7260 15:50:19.595909 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:20.167023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19080): Launched 15:50:20.485952 run osmo-msc_10.42.42.6(pid=19081): Launched 15:50:20.664260 run osmo-stp_10.42.42.5(pid=19078): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19078)] 15:50:20.801985 run osmo-stp_10.42.42.5(pid=19078): stdout: | (launched: 2022-12-09_15:50:19.240011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:20.932396 run osmo-stp_10.42.42.5(pid=19078): stderr: | [0;m[38;5;43m20221209155019433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155019433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155019433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155019434 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155019434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155019434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155019434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:21.064221 run osmo-stp_10.42.42.5(pid=19078): stdout: | (launched: 2022-12-09_15:50:19.240011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:21.190548 run osmo-stp_10.42.42.5(pid=19078): stderr: | [0;m[38;5;43m20221209155019433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155019433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155019433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155019434 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155019434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155019434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155019434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:21.341640 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=19078): Process ended prematurely: osmo-stp_10.42.42.5(pid=19078) [trial-2361↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19078)] [trial-2361↪emergency:oc2g↪emergency_preemptive_call.py:32] 15:50:21.350557 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 15:50:21.378644 run osmo-hlr_10.42.42.2(pid=19075): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19075)] 15:50:21.428639 run osmo-hlr_10.42.42.2(pid=19075): stdout: | (launched: 2022-12-09_15:50:18.250120) 15:50:21.480420 run osmo-hlr_10.42.42.2(pid=19075): stderr: | [0;m[1;31m20221209155018447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155018447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155018447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155018447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155018447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155018447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155018459 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155018467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155018468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155018468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:21.552558 run osmo-msc_10.42.42.6(pid=19081): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19081)] 15:50:21.602446 run osmo-msc_10.42.42.6(pid=19081): stdout: | (launched: 2022-12-09_15:50:20.426391) 15:50:21.654658 run osmo-msc_10.42.42.6(pid=19081): stderr: | [0;m[38;5;43m20221209155020751 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155020751 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0115590c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155020751 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155020751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155020751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155020752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155020753 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155020754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155020754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155020754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:21.707062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19074): Terminating (SIGTERM) 15:50:21.748566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19077): Terminating (SIGTERM) 15:50:21.790263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19080): Terminating (SIGTERM) 15:50:21.832254 --- ParallelTerminationStrategy: PID 19074 died... 15:50:21.852222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19074): Terminated: ok {rc=0} 15:50:21.898710 --- ParallelTerminationStrategy: PID 19077 died... 15:50:21.918071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19077): Terminated: ok {rc=0} 15:50:21.964219 --- ParallelTerminationStrategy: PID 19080 died... 15:50:21.983817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19080): Terminated: ok {rc=0} 15:50:22.072578 bus /sierra_9: Setting Powered False 15:50:23.171145 bus /sierra_9: Setting Powered False 15:50:24.290123 bus /sierra_8: Setting Powered False 15:50:25.388288 bus /sierra_8: Setting Powered False 15:50:26.502690 bus /sierra_3: Setting Powered False 15:50:27.601096 bus /sierra_3: Setting Powered False 15:50:28.716233 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:oc2g --------------------------------------------------------------------- 15:50:29.975116 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:50:29.980159 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 15:50:30.000541 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 15:50:30.039100 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 15:50:30.125591 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 15:50:30.145740 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 15:50:30.183647 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 15:50:30.771371 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 15:50:30.819868 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:30.830423 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:50:30.872804 tst cs_paging_gprs_active.py: using LAC 22087 15:50:31.008289 tst cs_paging_gprs_active.py: using RAC 157 15:50:31.165263 tst cs_paging_gprs_active.py: using CellId 22087 15:50:31.303032 tst cs_paging_gprs_active.py: using BVCI 22088 15:50:31.427538 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:31.439475 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:31.451189 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:31.464165 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:31.476554 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:31.490387 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:31.503387 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:31.515041 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:31.527945 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:50:31.654083 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:50:31.795438 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:50:32.000929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:50:32.305807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19087): Launched 15:50:32.567551 run iperf3-srv_10.42.42.10(pid=19088): Launched 15:50:32.679961 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:50:32.881329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:50:33.184503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19089): Launched 15:50:33.447751 run iperf3-srv_10.42.42.10(pid=19090): Launched 15:50:33.560065 tst cs_paging_gprs_active.py:38: start network... 15:50:33.762244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:34.227088 run create_hlr_db(pid=19091): Launched 15:50:34.349388 bus /sierra_2: Setting Powered False 15:50:35.409187 run create_hlr_db(pid=19091): Terminated: ok {rc=0} 15:50:35.828526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19093): Launched 15:50:36.129519 run osmo-hlr_10.42.42.2(pid=19094): Launched 15:50:36.242770 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:36.756905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19096): Launched 15:50:37.058088 run osmo-stp_10.42.42.5(pid=19097): Launched 15:50:37.171743 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:50:37.687924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19099): Launched 15:50:37.802741 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:50:38.056697 run patchelf(pid=19100): Launched 15:50:38.223916 run osmo-stp_10.42.42.5(pid=19097): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19097)] 15:50:38.350612 run osmo-stp_10.42.42.5(pid=19097): stdout: | (launched: 2022-12-09_15:50:37.001871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:38.479463 run osmo-stp_10.42.42.5(pid=19097): stderr: | [0;m[38;5;43m20221209155037173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155037173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155037173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155037174 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155037174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155037174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155037174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:38.608306 run osmo-stp_10.42.42.5(pid=19097): stdout: | (launched: 2022-12-09_15:50:37.001871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:38.730753 run osmo-stp_10.42.42.5(pid=19097): stderr: | [0;m[38;5;43m20221209155037173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155037173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155037173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155037174 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155037174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155037174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155037174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:38.875949 run patchelf(pid=19100): Terminating (SIGINT) 15:50:39.045862 run patchelf(pid=19100): Terminated: ok {rc=0} 15:50:39.168274 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19097): Process ended prematurely: osmo-stp_10.42.42.5(pid=19097) [trial-2361↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19097)] [trial-2361↪gprs:oc2g↪cs_paging_gprs_active.py:38] 15:50:39.177597 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 15:50:39.204625 run osmo-hlr_10.42.42.2(pid=19094): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19094)] 15:50:39.251397 run osmo-hlr_10.42.42.2(pid=19094): stdout: | (launched: 2022-12-09_15:50:36.072915) 15:50:39.301018 run osmo-hlr_10.42.42.2(pid=19094): stderr: | [0;m[1;31m20221209155036253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155036253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155036253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155036253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155036253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155036253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155036266 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155036274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155036274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155036274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:39.350240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19087): Terminating (SIGTERM) 15:50:39.389479 run iperf3-srv_10.42.42.10(pid=19088): Terminating (SIGTERM) 15:50:39.428455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19089): Terminating (SIGTERM) 15:50:39.467380 run iperf3-srv_10.42.42.10(pid=19090): Terminating (SIGTERM) 15:50:39.506084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19093): Terminating (SIGTERM) 15:50:39.545252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19096): Terminating (SIGTERM) 15:50:39.584396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19099): Terminating (SIGTERM) 15:50:39.624103 --- ParallelTerminationStrategy: PID 19087 died... 15:50:39.642692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19087): Terminated: ok {rc=0} 15:50:39.686311 --- ParallelTerminationStrategy: PID 19088 died... 15:50:39.704639 run iperf3-srv_10.42.42.10(pid=19088): Terminated {rc=256} 15:50:39.748073 --- ParallelTerminationStrategy: PID 19089 died... 15:50:39.767023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19089): Terminated: ok {rc=0} 15:50:39.810604 --- ParallelTerminationStrategy: PID 19090 died... 15:50:39.828822 run iperf3-srv_10.42.42.10(pid=19090): Terminated {rc=256} 15:50:39.872522 --- ParallelTerminationStrategy: PID 19093 died... 15:50:39.890772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19093): Terminated: ok {rc=0} 15:50:39.934161 --- ParallelTerminationStrategy: PID 19096 died... 15:50:39.952324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19096): Terminated: ok {rc=0} 15:50:39.995968 --- ParallelTerminationStrategy: PID 19099 died... 15:50:40.014247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19099): Terminated: ok {rc=0} 15:50:40.096644 bus /gobi_0: Setting Powered False 15:50:41.192928 bus /gobi_0: Setting Powered False 15:50:42.306992 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g iperf3.py ---------------------------------------------- 15:50:43.454615 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:43.466285 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:50:43.507484 tst iperf3.py: using LAC 22088 15:50:43.633468 tst iperf3.py: using RAC 158 15:50:43.759808 tst iperf3.py: using CellId 22088 15:50:43.885205 tst iperf3.py: using BVCI 22089 15:50:44.003604 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.014607 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.025519 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.036476 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.047440 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.058409 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.069578 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.080615 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:44.091881 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:50:44.210935 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:50:44.430079 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:50:44.757183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19101): Launched 15:50:45.039075 run iperf3-srv_10.42.42.10(pid=19102): Launched 15:50:45.159827 tst iperf3.py:8: start network... 15:50:45.378444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:45.892453 run create_hlr_db(pid=19103): Launched 15:50:46.060767 bus /gobi_6: Setting Powered False 15:50:47.122877 run create_hlr_db(pid=19103): Terminated: ok {rc=0} 15:50:47.556274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19105): Launched 15:50:47.860362 run osmo-hlr_10.42.42.2(pid=19106): Launched 15:50:47.974185 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:48.506261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19108): Launched 15:50:48.807996 run osmo-stp_10.42.42.5(pid=19109): Launched 15:50:48.921788 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:50:49.441074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19111): Launched 15:50:49.556653 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:50:49.811037 run patchelf(pid=19112): Launched 15:50:49.978741 run osmo-stp_10.42.42.5(pid=19109): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19109)] 15:50:50.106388 run osmo-stp_10.42.42.5(pid=19109): stdout: | (launched: 2022-12-09_15:50:48.751440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:50.235390 run osmo-stp_10.42.42.5(pid=19109): stderr: | [0;m[38;5;43m20221209155048922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155048922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155048922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155048922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155048923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155048923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155048923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:50.364622 run osmo-stp_10.42.42.5(pid=19109): stdout: | (launched: 2022-12-09_15:50:48.751440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:50.487540 run osmo-stp_10.42.42.5(pid=19109): stderr: | [0;m[38;5;43m20221209155048922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155048922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155048922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155048922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155048923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155048923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155048923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:50.632914 run patchelf(pid=19112): Terminating (SIGINT) 15:50:50.801393 run patchelf(pid=19112): Terminated: ok {rc=0} 15:50:50.922871 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19109): Process ended prematurely: osmo-stp_10.42.42.5(pid=19109) [trial-2361↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19109)] [trial-2361↪gprs:oc2g↪iperf3.py:8] 15:50:50.931998 tst iperf3.py:8: Test FAILED (7.5 sec) 15:50:50.958889 run osmo-hlr_10.42.42.2(pid=19106): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19106)] 15:50:51.006425 run osmo-hlr_10.42.42.2(pid=19106): stdout: | (launched: 2022-12-09_15:50:47.803303) 15:50:51.055315 run osmo-hlr_10.42.42.2(pid=19106): stderr: | [0;m[1;31m20221209155047982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155047982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155047982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155047982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155047982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155047982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155047994 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155048005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155048005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155048005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:51.105383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19101): Terminating (SIGTERM) 15:50:51.145559 run iperf3-srv_10.42.42.10(pid=19102): Terminating (SIGTERM) 15:50:51.186586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19105): Terminating (SIGTERM) 15:50:51.226591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19108): Terminating (SIGTERM) 15:50:51.266065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19111): Terminating (SIGTERM) 15:50:51.305648 --- ParallelTerminationStrategy: PID 19101 died... 15:50:51.324550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19101): Terminated: ok {rc=0} 15:50:51.368614 --- ParallelTerminationStrategy: PID 19102 died... 15:50:51.387118 run iperf3-srv_10.42.42.10(pid=19102): Terminated {rc=256} 15:50:51.430352 --- ParallelTerminationStrategy: PID 19105 died... 15:50:51.449240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19105): Terminated: ok {rc=0} 15:50:51.492256 --- ParallelTerminationStrategy: PID 19108 died... 15:50:51.510560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19108): Terminated: ok {rc=0} 15:50:51.553304 --- ParallelTerminationStrategy: PID 19111 died... 15:50:51.571425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19111): Terminated: ok {rc=0} 15:50:51.655267 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g iperf3m4.py ---------------------------------------------- 15:50:52.801536 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:52.812581 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:50:52.847900 tst iperf3m4.py: using LAC 22089 15:50:52.967112 tst iperf3m4.py: using RAC 159 15:50:53.087075 tst iperf3m4.py: using CellId 22089 15:50:53.206024 tst iperf3m4.py: using BVCI 22090 15:50:53.316531 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:53.326966 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:53.337372 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:53.347702 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:53.357945 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:53.368129 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:53.378434 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:53.388546 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:50:53.398980 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:50:53.518006 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:50:53.638217 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:50:53.757343 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:50:53.875128 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:50:54.094034 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:50:54.422040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19113): Launched 15:50:54.706148 run iperf3-srv_10.42.42.10(pid=19114): Launched 15:50:54.826997 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:50:55.046355 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:50:55.371820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19115): Launched 15:50:55.654608 run iperf3-srv_10.42.42.10(pid=19116): Launched 15:50:55.775196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:50:55.993798 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:50:56.319915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19117): Launched 15:50:56.604550 run iperf3-srv_10.42.42.10(pid=19118): Launched 15:50:56.724898 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:50:56.943392 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:50:57.268615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19119): Launched 15:50:57.550190 run iperf3-srv_10.42.42.10(pid=19120): Launched 15:50:57.671087 tst iperf3m4.py:8: start network... 15:50:57.889639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:58.391029 run create_hlr_db(pid=19121): Launched 15:50:58.513659 bus /gobi_6: Setting Powered False 15:50:59.577771 run create_hlr_db(pid=19121): Terminated: ok {rc=0} 15:51:00.028458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19123): Launched 15:51:00.351840 run osmo-hlr_10.42.42.2(pid=19124): Launched 15:51:00.475017 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:01.052737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19126): Launched 15:51:01.405820 run osmo-stp_10.42.42.5(pid=19127): Launched 15:51:01.686572 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:51:02.359622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19129): Launched 15:51:02.486204 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:51:02.761981 run patchelf(pid=19130): Launched 15:51:02.942029 run osmo-stp_10.42.42.5(pid=19127): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19127)] 15:51:03.079238 run osmo-stp_10.42.42.5(pid=19127): stdout: | (launched: 2022-12-09_15:51:01.334901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:03.218045 run osmo-stp_10.42.42.5(pid=19127): stderr: | [0;m[38;5;43m20221209155101619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155101619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155101619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155101620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155101620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155101620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155101620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:03.357047 run osmo-stp_10.42.42.5(pid=19127): stdout: | (launched: 2022-12-09_15:51:01.334901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:03.489185 run osmo-stp_10.42.42.5(pid=19127): stderr: | [0;m[38;5;43m20221209155101619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155101619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155101619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155101620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155101620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155101620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155101620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:03.646633 run patchelf(pid=19130): Terminating (SIGINT) 15:51:03.828228 run patchelf(pid=19130): Terminated: ok {rc=0} 15:51:03.959256 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19127): Process ended prematurely: osmo-stp_10.42.42.5(pid=19127) [trial-2361↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19127)] [trial-2361↪gprs:oc2g↪iperf3m4.py:8] 15:51:03.969255 tst iperf3m4.py:8: Test FAILED (11.2 sec) 15:51:03.998462 run osmo-hlr_10.42.42.2(pid=19124): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19124)] 15:51:04.048340 run osmo-hlr_10.42.42.2(pid=19124): stdout: | (launched: 2022-12-09_15:51:00.291948) 15:51:04.099905 run osmo-hlr_10.42.42.2(pid=19124): stderr: | [0;m[1;31m20221209155100489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155100489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155100489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155100489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155100489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155100489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155100502 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155100511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155100512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155100512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:04.152065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19113): Terminating (SIGTERM) 15:51:04.194186 run iperf3-srv_10.42.42.10(pid=19114): Terminating (SIGTERM) 15:51:04.235968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19115): Terminating (SIGTERM) 15:51:04.277793 run iperf3-srv_10.42.42.10(pid=19116): Terminating (SIGTERM) 15:51:04.319584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19117): Terminating (SIGTERM) 15:51:04.361363 run iperf3-srv_10.42.42.10(pid=19118): Terminating (SIGTERM) 15:51:04.403078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19119): Terminating (SIGTERM) 15:51:04.444834 run iperf3-srv_10.42.42.10(pid=19120): Terminating (SIGTERM) 15:51:04.486593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19123): Terminating (SIGTERM) 15:51:04.528330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19126): Terminating (SIGTERM) 15:51:04.570259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19129): Terminating (SIGTERM) 15:51:04.612674 --- ParallelTerminationStrategy: PID 19113 died... 15:51:04.632301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19113): Terminated: ok {rc=0} 15:51:04.678944 --- ParallelTerminationStrategy: PID 19114 died... 15:51:04.698469 run iperf3-srv_10.42.42.10(pid=19114): Terminated {rc=256} 15:51:04.744889 --- ParallelTerminationStrategy: PID 19115 died... 15:51:04.764770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19115): Terminated: ok {rc=0} 15:51:04.811027 --- ParallelTerminationStrategy: PID 19116 died... 15:51:04.830509 run iperf3-srv_10.42.42.10(pid=19116): Terminated {rc=256} 15:51:04.876709 --- ParallelTerminationStrategy: PID 19117 died... 15:51:04.896190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19117): Terminated: ok {rc=0} 15:51:04.942486 --- ParallelTerminationStrategy: PID 19118 died... 15:51:04.961971 run iperf3-srv_10.42.42.10(pid=19118): Terminated {rc=256} 15:51:05.008097 --- ParallelTerminationStrategy: PID 19119 died... 15:51:05.027547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19119): Terminated: ok {rc=0} 15:51:05.073856 --- ParallelTerminationStrategy: PID 19120 died... 15:51:05.093388 run iperf3-srv_10.42.42.10(pid=19120): Terminated {rc=256} 15:51:05.139699 --- ParallelTerminationStrategy: PID 19123 died... 15:51:05.159219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19123): Terminated: ok {rc=0} 15:51:05.205633 --- ParallelTerminationStrategy: PID 19126 died... 15:51:05.225160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19126): Terminated: ok {rc=0} 15:51:05.271368 --- ParallelTerminationStrategy: PID 19129 died... 15:51:05.290796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19129): Terminated: ok {rc=0} 15:51:05.378371 bus /gobi_4: Setting Powered False 15:51:06.476458 bus /gobi_4: Setting Powered False 15:51:07.591489 bus /gobi_1: Setting Powered False 15:51:08.688814 bus /gobi_1: Setting Powered False 15:51:09.804603 bus /gobi_0: Setting Powered False 15:51:10.901732 bus /gobi_0: Setting Powered False 15:51:12.017052 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g ping.py ---------------------------------------------- 15:51:13.119094 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:13.130556 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:51:13.172618 tst ping.py: using LAC 22090 15:51:13.295575 tst ping.py: using RAC 160 15:51:13.411606 tst ping.py: using CellId 22090 15:51:13.526396 tst ping.py: using BVCI 22091 15:51:13.633938 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:13.644624 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:13.655238 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:13.666459 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:13.677500 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:13.688454 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:13.699397 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:13.710210 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:51:13.830594 tst ping.py:19: start network... 15:51:14.046597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:14.538694 run create_hlr_db(pid=19131): Launched 15:51:14.660095 bus /gobi_6: Setting Powered False 15:51:15.723432 run create_hlr_db(pid=19131): Terminated: ok {rc=0} 15:51:16.182692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19133): Launched 15:51:16.521220 run osmo-hlr_10.42.42.2(pid=19134): Launched 15:51:16.769050 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:17.419209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19136): Launched 15:51:17.739822 run osmo-stp_10.42.42.5(pid=19137): Launched 15:51:17.861114 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:51:18.409904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19139): Launched 15:51:18.531370 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:51:18.801326 run patchelf(pid=19140): Launched 15:51:18.979405 run osmo-stp_10.42.42.5(pid=19137): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19137)] 15:51:19.114627 run osmo-stp_10.42.42.5(pid=19137): stdout: | (launched: 2022-12-09_15:51:17.680498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:19.251613 run osmo-stp_10.42.42.5(pid=19137): stderr: | [0;m[38;5;43m20221209155117873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155117873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155117873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155117874 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155117874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155117874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155117874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:19.388286 run osmo-stp_10.42.42.5(pid=19137): stdout: | (launched: 2022-12-09_15:51:17.680498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:19.519105 run osmo-stp_10.42.42.5(pid=19137): stderr: | [0;m[38;5;43m20221209155117873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155117873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155117873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155117874 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155117874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155117874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155117874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:19.674353 run patchelf(pid=19140): Terminating (SIGINT) 15:51:19.851761 run patchelf(pid=19140): Terminated: ok {rc=0} 15:51:19.979773 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19137): Process ended prematurely: osmo-stp_10.42.42.5(pid=19137) [trial-2361↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19137)] [trial-2361↪gprs:oc2g↪ping.py:22] 15:51:19.989187 tst ping.py:22: Test FAILED (6.9 sec) 15:51:20.017885 run osmo-hlr_10.42.42.2(pid=19134): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19134)] 15:51:20.067887 run osmo-hlr_10.42.42.2(pid=19134): stdout: | (launched: 2022-12-09_15:51:16.457364) 15:51:20.120203 run osmo-hlr_10.42.42.2(pid=19134): stderr: | [0;m[1;31m20221209155116765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155116765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155116765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155116765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155116765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155116765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155116788 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155116797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155116797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155116797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:20.172240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19133): Terminating (SIGTERM) 15:51:20.214095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19136): Terminating (SIGTERM) 15:51:20.256024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19139): Terminating (SIGTERM) 15:51:20.298325 --- ParallelTerminationStrategy: PID 19133 died... 15:51:20.318319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19133): Terminated: ok {rc=0} 15:51:20.364935 --- ParallelTerminationStrategy: PID 19136 died... 15:51:20.384626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19136): Terminated: ok {rc=0} 15:51:20.431371 --- ParallelTerminationStrategy: PID 19139 died... 15:51:20.450997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19139): Terminated: ok {rc=0} 15:51:20.538698 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 15:51:21.626233 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:21.638112 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:51:21.677536 tst ping_idle_ping.py: using LAC 22091 15:51:21.803803 tst ping_idle_ping.py: using RAC 161 15:51:21.931002 tst ping_idle_ping.py: using CellId 22091 15:51:22.051107 tst ping_idle_ping.py: using BVCI 22092 15:51:22.160580 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:22.171242 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:22.181853 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:22.192515 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:22.203059 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:22.213521 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:22.223967 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:51:22.234850 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:51:22.347259 tst ping_idle_ping.py:24: start network... 15:51:22.545695 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:23.004209 run create_hlr_db(pid=19141): Launched 15:51:23.125227 bus /gobi_6: Setting Powered False 15:51:24.184904 run create_hlr_db(pid=19141): Terminated: ok {rc=0} 15:51:24.621576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19143): Launched 15:51:24.939348 run osmo-hlr_10.42.42.2(pid=19144): Launched 15:51:25.061072 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:25.611286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19146): Launched 15:51:25.931840 run osmo-stp_10.42.42.5(pid=19147): Launched 15:51:26.053486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:51:26.603244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19149): Launched 15:51:26.725093 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:51:26.994882 run patchelf(pid=19150): Launched 15:51:27.171624 run osmo-stp_10.42.42.5(pid=19147): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19147)] 15:51:27.307012 run osmo-stp_10.42.42.5(pid=19147): stdout: | (launched: 2022-12-09_15:51:25.872443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:27.444050 run osmo-stp_10.42.42.5(pid=19147): stderr: | [0;m[38;5;43m20221209155126064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155126064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155126064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155126065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155126065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155126065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155126065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:27.581195 run osmo-stp_10.42.42.5(pid=19147): stdout: | (launched: 2022-12-09_15:51:25.872443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:27.712694 run osmo-stp_10.42.42.5(pid=19147): stderr: | [0;m[38;5;43m20221209155126064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155126064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155126064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155126065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155126065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155126065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155126065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:27.867479 run patchelf(pid=19150): Terminating (SIGINT) 15:51:28.045715 run patchelf(pid=19150): Terminated: ok {rc=0} 15:51:28.174176 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19147): Process ended prematurely: osmo-stp_10.42.42.5(pid=19147) [trial-2361↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19147)] [trial-2361↪gprs:oc2g↪ping_idle_ping.py:27] 15:51:28.183576 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 15:51:28.212055 run osmo-hlr_10.42.42.2(pid=19144): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19144)] 15:51:28.261640 run osmo-hlr_10.42.42.2(pid=19144): stdout: | (launched: 2022-12-09_15:51:24.880454) 15:51:28.313262 run osmo-hlr_10.42.42.2(pid=19144): stderr: | [0;m[1;31m20221209155125078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155125078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155125078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155125078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155125078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155125078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155125091 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155125099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155125099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155125099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:28.365202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19143): Terminating (SIGTERM) 15:51:28.406675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19146): Terminating (SIGTERM) 15:51:28.448321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19149): Terminating (SIGTERM) 15:51:28.490119 --- ParallelTerminationStrategy: PID 19143 died... 15:51:28.509931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19143): Terminated: ok {rc=0} 15:51:28.555986 --- ParallelTerminationStrategy: PID 19146 died... 15:51:28.575341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19146): Terminated: ok {rc=0} 15:51:28.621586 --- ParallelTerminationStrategy: PID 19149 died... 15:51:28.640819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19149): Terminated: ok {rc=0} 15:51:28.727369 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 15:51:30.017137 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:51:30.023116 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 15:51:30.044449 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 15:51:30.083430 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 15:51:30.173431 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 15:51:30.194950 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 15:51:30.234025 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 15:51:30.825491 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 15:51:30.883430 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:30.894882 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:51:30.943276 tst cs_paging_gprs_active.py: using LAC 22092 15:51:31.075138 tst cs_paging_gprs_active.py: using RAC 162 15:51:31.201159 tst cs_paging_gprs_active.py: using CellId 22092 15:51:31.324458 tst cs_paging_gprs_active.py: using BVCI 22093 15:51:31.438172 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:31.449449 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:31.460735 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:31.471993 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:31.483374 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:31.494315 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:31.505632 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:31.517049 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:31.528480 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:51:31.646421 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:51:31.765525 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:51:31.985730 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:32.306110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19155): Launched 15:51:32.565014 run iperf3-srv_10.42.42.10(pid=19156): Launched 15:51:32.675092 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:51:32.871925 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:33.169065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19157): Launched 15:51:33.427625 run iperf3-srv_10.42.42.10(pid=19158): Launched 15:51:33.537591 tst cs_paging_gprs_active.py:38: start network... 15:51:33.734073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:34.192606 run create_hlr_db(pid=19159): Launched 15:51:34.314788 bus /gobi_6: Setting Powered False 15:51:35.373520 run create_hlr_db(pid=19159): Terminated: ok {rc=0} 15:51:35.807571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19161): Launched 15:51:36.124793 run osmo-hlr_10.42.42.2(pid=19162): Launched 15:51:36.245157 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:36.788495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19164): Launched 15:51:37.105985 run osmo-stp_10.42.42.5(pid=19165): Launched 15:51:37.225540 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:51:37.772766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19167): Launched 15:51:37.894380 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:51:38.163607 run patchelf(pid=19168): Launched 15:51:38.339991 run osmo-stp_10.42.42.5(pid=19165): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19165)] 15:51:38.474904 run osmo-stp_10.42.42.5(pid=19165): stdout: | (launched: 2022-12-09_15:51:37.047257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:38.611319 run osmo-stp_10.42.42.5(pid=19165): stderr: | [0;m[38;5;43m20221209155137239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155137240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155137240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155137240 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155137241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155137241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155137241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:38.747962 run osmo-stp_10.42.42.5(pid=19165): stdout: | (launched: 2022-12-09_15:51:37.047257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:38.878001 run osmo-stp_10.42.42.5(pid=19165): stderr: | [0;m[38;5;43m20221209155137239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155137240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155137240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155137240 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155137241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155137241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155137241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:39.031969 run patchelf(pid=19168): Terminating (SIGINT) 15:51:39.210714 run patchelf(pid=19168): Terminated: ok {rc=0} 15:51:39.339240 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19165): Process ended prematurely: osmo-stp_10.42.42.5(pid=19165) [trial-2361↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19165)] [trial-2361↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 15:51:39.349584 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 15:51:39.377841 run osmo-hlr_10.42.42.2(pid=19162): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19162)] 15:51:39.427814 run osmo-hlr_10.42.42.2(pid=19162): stdout: | (launched: 2022-12-09_15:51:36.066095) 15:51:39.479345 run osmo-hlr_10.42.42.2(pid=19162): stderr: | [0;m[1;31m20221209155136265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155136265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155136265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155136265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155136265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155136265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155136278 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155136286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155136286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155136286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:39.531345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19155): Terminating (SIGTERM) 15:51:39.573230 run iperf3-srv_10.42.42.10(pid=19156): Terminating (SIGTERM) 15:51:39.615276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19157): Terminating (SIGTERM) 15:51:39.657161 run iperf3-srv_10.42.42.10(pid=19158): Terminating (SIGTERM) 15:51:39.698838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19161): Terminating (SIGTERM) 15:51:39.740560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19164): Terminating (SIGTERM) 15:51:39.782519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19167): Terminating (SIGTERM) 15:51:39.824480 --- ParallelTerminationStrategy: PID 19155 died... 15:51:39.844386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19155): Terminated: ok {rc=0} 15:51:39.891071 --- ParallelTerminationStrategy: PID 19156 died... 15:51:39.910259 run iperf3-srv_10.42.42.10(pid=19156): Terminated {rc=256} 15:51:39.956527 --- ParallelTerminationStrategy: PID 19157 died... 15:51:39.975702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19157): Terminated: ok {rc=0} 15:51:40.021860 --- ParallelTerminationStrategy: PID 19158 died... 15:51:40.041018 run iperf3-srv_10.42.42.10(pid=19158): Terminated {rc=256} 15:51:40.086994 --- ParallelTerminationStrategy: PID 19161 died... 15:51:40.106214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19161): Terminated: ok {rc=0} 15:51:40.152072 --- ParallelTerminationStrategy: PID 19164 died... 15:51:40.171247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19164): Terminated: ok {rc=0} 15:51:40.217510 --- ParallelTerminationStrategy: PID 19167 died... 15:51:40.237030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19167): Terminated: ok {rc=0} 15:51:40.325125 bus /gobi_0: Setting Powered False 15:51:41.423970 bus /gobi_0: Setting Powered False 15:51:42.540556 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 15:51:43.684021 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:43.695250 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:51:43.733214 tst iperf3.py: using LAC 22093 15:51:43.850325 tst iperf3.py: using RAC 163 15:51:43.967675 tst iperf3.py: using CellId 22093 15:51:44.083136 tst iperf3.py: using BVCI 22094 15:51:44.189675 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.200175 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.210673 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.221272 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.231585 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.242011 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.252496 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.262923 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:44.273952 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:51:44.394775 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:51:44.608322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:44.927628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19169): Launched 15:51:45.203707 run iperf3-srv_10.42.42.10(pid=19170): Launched 15:51:45.314085 tst iperf3.py:8: start network... 15:51:45.511279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:45.995291 run create_hlr_db(pid=19171): Launched 15:51:46.154441 bus /gobi_6: Setting Powered False 15:51:47.212319 run create_hlr_db(pid=19171): Terminated: ok {rc=0} 15:51:47.679014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19173): Launched 15:51:47.994796 run osmo-hlr_10.42.42.2(pid=19174): Launched 15:51:48.114314 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:48.661415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19176): Launched 15:51:48.977724 run osmo-stp_10.42.42.5(pid=19177): Launched 15:51:49.097976 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:51:49.641611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19179): Launched 15:51:49.762552 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:51:50.029862 run patchelf(pid=19180): Launched 15:51:50.206993 run osmo-stp_10.42.42.5(pid=19177): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19177)] 15:51:50.341808 run osmo-stp_10.42.42.5(pid=19177): stdout: | (launched: 2022-12-09_15:51:48.919023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:50.477608 run osmo-stp_10.42.42.5(pid=19177): stderr: | [0;m[38;5;43m20221209155149112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155149112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155149112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155149112 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155149113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155149113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155149113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:50.613990 run osmo-stp_10.42.42.5(pid=19177): stdout: | (launched: 2022-12-09_15:51:48.919023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:50.743927 run osmo-stp_10.42.42.5(pid=19177): stderr: | [0;m[38;5;43m20221209155149112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155149112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155149112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155149112 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155149113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155149113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155149113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:50.897537 run patchelf(pid=19180): Terminating (SIGINT) 15:51:51.074333 run patchelf(pid=19180): Terminated: ok {rc=0} 15:51:51.202398 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19177): Process ended prematurely: osmo-stp_10.42.42.5(pid=19177) [trial-2361↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19177)] [trial-2361↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 15:51:51.212390 tst iperf3.py:8: Test FAILED (7.6 sec) 15:51:51.241149 run osmo-hlr_10.42.42.2(pid=19174): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19174)] 15:51:51.291216 run osmo-hlr_10.42.42.2(pid=19174): stdout: | (launched: 2022-12-09_15:51:47.936607) 15:51:51.342886 run osmo-hlr_10.42.42.2(pid=19174): stderr: | [0;m[1;31m20221209155148137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155148137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155148137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155148137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155148137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155148137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155148150 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155148158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155148159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155148159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:51.395458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19169): Terminating (SIGTERM) 15:51:51.437288 run iperf3-srv_10.42.42.10(pid=19170): Terminating (SIGTERM) 15:51:51.478928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19173): Terminating (SIGTERM) 15:51:51.520608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19176): Terminating (SIGTERM) 15:51:51.562656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19179): Terminating (SIGTERM) 15:51:51.604662 --- ParallelTerminationStrategy: PID 19169 died... 15:51:51.624756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19169): Terminated: ok {rc=0} 15:51:51.670981 --- ParallelTerminationStrategy: PID 19170 died... 15:51:51.690492 run iperf3-srv_10.42.42.10(pid=19170): Terminated {rc=256} 15:51:51.736826 --- ParallelTerminationStrategy: PID 19173 died... 15:51:51.756605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19173): Terminated: ok {rc=0} 15:51:51.803177 --- ParallelTerminationStrategy: PID 19176 died... 15:51:51.822721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19176): Terminated: ok {rc=0} 15:51:51.869724 --- ParallelTerminationStrategy: PID 19179 died... 15:51:51.889393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19179): Terminated: ok {rc=0} 15:51:51.977090 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 15:51:53.125840 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:53.137587 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:51:53.179279 tst iperf3m4.py: using LAC 22094 15:51:53.303903 tst iperf3m4.py: using RAC 164 15:51:53.420030 tst iperf3m4.py: using CellId 22094 15:51:53.544124 tst iperf3m4.py: using BVCI 22095 15:51:53.659158 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:53.670486 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:53.681541 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:53.692705 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:53.703848 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:53.714974 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:53.726447 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:53.737616 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:51:53.748842 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:51:53.869946 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:51:53.985690 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:51:54.104719 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:51:54.224227 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:51:54.438702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:54.760720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19181): Launched 15:51:55.036201 run iperf3-srv_10.42.42.10(pid=19182): Launched 15:51:55.154157 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:51:55.367322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:55.686352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19183): Launched 15:51:55.962200 run iperf3-srv_10.42.42.10(pid=19184): Launched 15:51:56.080195 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:51:56.293380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:56.612537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19185): Launched 15:51:56.888457 run iperf3-srv_10.42.42.10(pid=19186): Launched 15:51:57.006427 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:51:57.219466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:51:57.538384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19187): Launched 15:51:57.815031 run iperf3-srv_10.42.42.10(pid=19188): Launched 15:51:57.932699 tst iperf3m4.py:8: start network... 15:51:58.145511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:58.635756 run create_hlr_db(pid=19189): Launched 15:51:58.757770 bus /gobi_6: Setting Powered False 15:51:59.820636 run create_hlr_db(pid=19189): Terminated: ok {rc=0} 15:52:00.262183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19191): Launched 15:52:00.580468 run osmo-hlr_10.42.42.2(pid=19192): Launched 15:52:00.702278 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:01.303093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19194): Launched 15:52:01.621886 run osmo-stp_10.42.42.5(pid=19195): Launched 15:52:01.743808 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:02.387324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19197): Launched 15:52:02.513734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:02.784172 run patchelf(pid=19198): Launched 15:52:02.961219 run osmo-stp_10.42.42.5(pid=19195): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19195)] 15:52:03.096109 run osmo-stp_10.42.42.5(pid=19195): stdout: | (launched: 2022-12-09_15:52:01.551679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:03.232677 run osmo-stp_10.42.42.5(pid=19195): stderr: | [0;m[38;5;43m20221209155201898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155201898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155201899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155201899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155201900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155201900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155201900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:03.369272 run osmo-stp_10.42.42.5(pid=19195): stdout: | (launched: 2022-12-09_15:52:01.551679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:03.498987 run osmo-stp_10.42.42.5(pid=19195): stderr: | [0;m[38;5;43m20221209155201898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155201898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155201899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155201899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155201900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155201900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155201900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:03.653191 run patchelf(pid=19198): Terminating (SIGINT) 15:52:03.831003 run patchelf(pid=19198): Terminated: ok {rc=0} 15:52:03.959348 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19195): Process ended prematurely: osmo-stp_10.42.42.5(pid=19195) [trial-2361↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19195)] [trial-2361↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 15:52:03.969326 tst iperf3m4.py:8: Test FAILED (10.9 sec) 15:52:03.998616 run osmo-hlr_10.42.42.2(pid=19192): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19192)] 15:52:04.048877 run osmo-hlr_10.42.42.2(pid=19192): stdout: | (launched: 2022-12-09_15:52:00.521642) 15:52:04.100618 run osmo-hlr_10.42.42.2(pid=19192): stderr: | [0;m[1;31m20221209155200717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155200717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155200717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155200717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155200718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155200718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155200730 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155200741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155200741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155200741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:04.152630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19181): Terminating (SIGTERM) 15:52:04.194347 run iperf3-srv_10.42.42.10(pid=19182): Terminating (SIGTERM) 15:52:04.236270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19183): Terminating (SIGTERM) 15:52:04.278374 run iperf3-srv_10.42.42.10(pid=19184): Terminating (SIGTERM) 15:52:04.320077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19185): Terminating (SIGTERM) 15:52:04.362046 run iperf3-srv_10.42.42.10(pid=19186): Terminating (SIGTERM) 15:52:04.403919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19187): Terminating (SIGTERM) 15:52:04.445942 run iperf3-srv_10.42.42.10(pid=19188): Terminating (SIGTERM) 15:52:04.487891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19191): Terminating (SIGTERM) 15:52:04.529972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19194): Terminating (SIGTERM) 15:52:04.571866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19197): Terminating (SIGTERM) 15:52:04.613976 --- ParallelTerminationStrategy: PID 19181 died... 15:52:04.633793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19181): Terminated: ok {rc=0} 15:52:04.680510 --- ParallelTerminationStrategy: PID 19182 died... 15:52:04.699978 run iperf3-srv_10.42.42.10(pid=19182): Terminated {rc=256} 15:52:04.746236 --- ParallelTerminationStrategy: PID 19183 died... 15:52:04.765722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19183): Terminated: ok {rc=0} 15:52:04.811929 --- ParallelTerminationStrategy: PID 19184 died... 15:52:04.831368 run iperf3-srv_10.42.42.10(pid=19184): Terminated {rc=256} 15:52:04.877562 --- ParallelTerminationStrategy: PID 19185 died... 15:52:04.897057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19185): Terminated: ok {rc=0} 15:52:04.943230 --- ParallelTerminationStrategy: PID 19186 died... 15:52:04.962672 run iperf3-srv_10.42.42.10(pid=19186): Terminated {rc=256} 15:52:05.008800 --- ParallelTerminationStrategy: PID 19187 died... 15:52:05.028567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19187): Terminated: ok {rc=0} 15:52:05.074904 --- ParallelTerminationStrategy: PID 19188 died... 15:52:05.094374 run iperf3-srv_10.42.42.10(pid=19188): Terminated {rc=256} 15:52:05.140678 --- ParallelTerminationStrategy: PID 19191 died... 15:52:05.160047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19191): Terminated: ok {rc=0} 15:52:05.206274 --- ParallelTerminationStrategy: PID 19194 died... 15:52:05.225789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19194): Terminated: ok {rc=0} 15:52:05.271941 --- ParallelTerminationStrategy: PID 19197 died... 15:52:05.291402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19197): Terminated: ok {rc=0} 15:52:05.378904 bus /gobi_4: Setting Powered False 15:52:06.477376 bus /gobi_4: Setting Powered False 15:52:07.591722 bus /gobi_1: Setting Powered False 15:52:08.688553 bus /gobi_1: Setting Powered False 15:52:09.802259 bus /gobi_0: Setting Powered False 15:52:10.898604 bus /gobi_0: Setting Powered False 15:52:12.013448 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 15:52:13.114169 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:13.126045 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:52:13.164664 tst ping.py: using LAC 22095 15:52:13.287737 tst ping.py: using RAC 165 15:52:13.408518 tst ping.py: using CellId 22095 15:52:13.529556 tst ping.py: using BVCI 22096 15:52:13.635599 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:13.646595 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:13.657472 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:13.668381 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:13.679124 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:13.689930 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:13.701272 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:13.712064 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:52:13.827242 tst ping.py:19: start network... 15:52:14.037052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:14.517445 run create_hlr_db(pid=19199): Launched 15:52:14.636138 bus /gobi_6: Setting Powered False 15:52:15.698134 run create_hlr_db(pid=19199): Terminated: ok {rc=0} 15:52:16.141277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19201): Launched 15:52:16.456068 run osmo-hlr_10.42.42.2(pid=19202): Launched 15:52:16.611833 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:17.398577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19204): Launched 15:52:17.689951 run osmo-stp_10.42.42.5(pid=19205): Launched 15:52:17.799703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:18.298666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19207): Launched 15:52:18.408687 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:18.655867 run patchelf(pid=19208): Launched 15:52:18.816717 run osmo-stp_10.42.42.5(pid=19205): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19205)] 15:52:18.940039 run osmo-stp_10.42.42.5(pid=19205): stdout: | (launched: 2022-12-09_15:52:17.635422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:19.064855 run osmo-stp_10.42.42.5(pid=19205): stderr: | [0;m[38;5;43m20221209155217804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155217804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155217804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155217805 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155217805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155217805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155217805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:19.189903 run osmo-stp_10.42.42.5(pid=19205): stdout: | (launched: 2022-12-09_15:52:17.635422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:19.308647 run osmo-stp_10.42.42.5(pid=19205): stderr: | [0;m[38;5;43m20221209155217804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155217804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155217804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155217805 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155217805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155217805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155217805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:19.449940 run patchelf(pid=19208): Terminating (SIGINT) 15:52:19.612418 run patchelf(pid=19208): Terminated: ok {rc=0} 15:52:19.729850 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19205): Process ended prematurely: osmo-stp_10.42.42.5(pid=19205) [trial-2361↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19205)] [trial-2361↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 15:52:19.738429 tst ping.py:22: Test FAILED (6.6 sec) 15:52:19.764616 run osmo-hlr_10.42.42.2(pid=19202): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19202)] 15:52:19.811736 run osmo-hlr_10.42.42.2(pid=19202): stdout: | (launched: 2022-12-09_15:52:16.393797) 15:52:19.861327 run osmo-hlr_10.42.42.2(pid=19202): stderr: | [0;m[1;31m20221209155216768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155216768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155216768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155216768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155216769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155216769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155216806 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155216826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155216826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155216826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:19.910697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19201): Terminating (SIGTERM) 15:52:19.950132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19204): Terminating (SIGTERM) 15:52:19.989632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19207): Terminating (SIGTERM) 15:52:20.029453 --- ParallelTerminationStrategy: PID 19201 died... 15:52:20.048402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19201): Terminated: ok {rc=0} 15:52:20.092253 --- ParallelTerminationStrategy: PID 19204 died... 15:52:20.110808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19204): Terminated: ok {rc=0} 15:52:20.154570 --- ParallelTerminationStrategy: PID 19207 died... 15:52:20.172929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19207): Terminated: ok {rc=0} 15:52:20.256607 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 15:52:21.342412 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:21.354574 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:52:21.394746 tst ping_idle_ping.py: using LAC 22096 15:52:21.517593 tst ping_idle_ping.py: using RAC 166 15:52:21.640319 tst ping_idle_ping.py: using CellId 22096 15:52:21.762848 tst ping_idle_ping.py: using BVCI 22097 15:52:21.876508 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:21.887666 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:21.898718 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:21.910065 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:21.921139 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:21.932163 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:21.943409 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:52:21.954631 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:52:22.070188 tst ping_idle_ping.py:24: start network... 15:52:22.266315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:22.721476 run create_hlr_db(pid=19209): Launched 15:52:22.840619 bus /gobi_6: Setting Powered False 15:52:23.899269 run create_hlr_db(pid=19209): Terminated: ok {rc=0} 15:52:24.309390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19211): Launched 15:52:24.602004 run osmo-hlr_10.42.42.2(pid=19212): Launched 15:52:24.713251 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:25.213942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19214): Launched 15:52:25.506684 run osmo-stp_10.42.42.5(pid=19215): Launched 15:52:25.617282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:26.120736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19217): Launched 15:52:26.232094 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:26.479883 run patchelf(pid=19218): Launched 15:52:26.643037 run osmo-stp_10.42.42.5(pid=19215): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19215)] 15:52:26.767276 run osmo-stp_10.42.42.5(pid=19215): stdout: | (launched: 2022-12-09_15:52:25.451780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:26.893267 run osmo-stp_10.42.42.5(pid=19215): stderr: | [0;m[38;5;43m20221209155225620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155225620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155225622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155225622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155225624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155225625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155225625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:27.019061 run osmo-stp_10.42.42.5(pid=19215): stdout: | (launched: 2022-12-09_15:52:25.451780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:27.139123 run osmo-stp_10.42.42.5(pid=19215): stderr: | [0;m[38;5;43m20221209155225620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155225620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155225622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155225622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155225624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155225625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155225625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:27.281425 run patchelf(pid=19218): Terminating (SIGINT) 15:52:27.445514 run patchelf(pid=19218): Terminated: ok {rc=0} 15:52:27.563619 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19215): Process ended prematurely: osmo-stp_10.42.42.5(pid=19215) [trial-2361↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19215)] [trial-2361↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 15:52:27.572410 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 15:52:27.599019 run osmo-hlr_10.42.42.2(pid=19212): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19212)] 15:52:27.646753 run osmo-hlr_10.42.42.2(pid=19212): stdout: | (launched: 2022-12-09_15:52:24.546635) 15:52:27.695950 run osmo-hlr_10.42.42.2(pid=19212): stderr: | [0;m[1;31m20221209155224726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155224726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155224726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155224726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155224726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155224726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155224741 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155224749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155224749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155224749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:27.745632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19211): Terminating (SIGTERM) 15:52:27.785851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19214): Terminating (SIGTERM) 15:52:27.825805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19217): Terminating (SIGTERM) 15:52:27.865818 --- ParallelTerminationStrategy: PID 19211 died... 15:52:27.885060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19211): Terminated: ok {rc=0} 15:52:27.929538 --- ParallelTerminationStrategy: PID 19214 died... 15:52:27.948041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19214): Terminated: ok {rc=0} 15:52:27.992287 --- ParallelTerminationStrategy: PID 19217 died... 15:52:28.011056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19217): Terminated: ok {rc=0} 15:52:28.096437 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 15:52:29.389901 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:52:29.397189 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 15:52:29.417967 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 15:52:29.455753 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 15:52:29.540322 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 15:52:29.560308 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 15:52:29.598731 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 15:52:30.193054 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 15:52:30.241753 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:30.252511 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:52:30.307435 tst cs_paging_gprs_active.py: using LAC 22097 15:52:30.432179 tst cs_paging_gprs_active.py: using RAC 167 15:52:30.554960 tst cs_paging_gprs_active.py: using CellId 22097 15:52:30.677751 tst cs_paging_gprs_active.py: using BVCI 22098 15:52:30.786046 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:30.796802 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:30.807323 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:30.818421 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:30.829940 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:30.853919 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:30.870973 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:30.882684 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:30.895723 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:52:31.047637 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:52:31.172673 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:52:31.466383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:31.846752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19223): Launched 15:52:32.136283 run iperf3-srv_10.42.42.10(pid=19224): Launched 15:52:32.278590 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:52:32.498840 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:32.825701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19225): Launched 15:52:33.106023 run iperf3-srv_10.42.42.10(pid=19226): Launched 15:52:33.227525 tst cs_paging_gprs_active.py:38: start network... 15:52:33.446044 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:33.945697 run create_hlr_db(pid=19227): Launched 15:52:34.069985 bus /gobi_6: Setting Powered False 15:52:35.133889 run create_hlr_db(pid=19227): Terminated: ok {rc=0} 15:52:35.582320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19229): Launched 15:52:35.908132 run osmo-hlr_10.42.42.2(pid=19232): Launched 15:52:36.025678 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:36.551849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19234): Launched 15:52:36.854604 run osmo-stp_10.42.42.5(pid=19235): Launched 15:52:36.968608 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:37.483897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19237): Launched 15:52:37.599117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:37.852761 run patchelf(pid=19238): Launched 15:52:38.022589 run osmo-stp_10.42.42.5(pid=19235): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19235)] 15:52:38.151713 run osmo-stp_10.42.42.5(pid=19235): stdout: | (launched: 2022-12-09_15:52:36.799044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:38.282779 run osmo-stp_10.42.42.5(pid=19235): stderr: | [0;m[38;5;43m20221209155236965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155236965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155236965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155236966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155236966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155236966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155236966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:38.413281 run osmo-stp_10.42.42.5(pid=19235): stdout: | (launched: 2022-12-09_15:52:36.799044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:38.537460 run osmo-stp_10.42.42.5(pid=19235): stderr: | [0;m[38;5;43m20221209155236965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155236965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155236965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155236966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155236966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155236966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155236966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:38.684360 run patchelf(pid=19238): Terminating (SIGINT) 15:52:38.855759 run patchelf(pid=19238): Terminated: ok {rc=0} 15:52:38.979889 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19235): Process ended prematurely: osmo-stp_10.42.42.5(pid=19235) [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19235)] [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 15:52:38.989299 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 15:52:39.016385 run osmo-hlr_10.42.42.2(pid=19232): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19232)] 15:52:39.064150 run osmo-hlr_10.42.42.2(pid=19232): stdout: | (launched: 2022-12-09_15:52:35.852605) 15:52:39.113571 run osmo-hlr_10.42.42.2(pid=19232): stderr: | [0;m[1;31m20221209155236022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155236022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155236022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155236022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155236022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155236022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155236034 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155236044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155236044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155236044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:39.163468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19223): Terminating (SIGTERM) 15:52:39.203045 run iperf3-srv_10.42.42.10(pid=19224): Terminating (SIGTERM) 15:52:39.242575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19225): Terminating (SIGTERM) 15:52:39.282228 run iperf3-srv_10.42.42.10(pid=19226): Terminating (SIGTERM) 15:52:39.321686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19229): Terminating (SIGTERM) 15:52:39.361739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19234): Terminating (SIGTERM) 15:52:39.401402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19237): Terminating (SIGTERM) 15:52:39.441362 --- ParallelTerminationStrategy: PID 19223 died... 15:52:39.460367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19223): Terminated: ok {rc=0} 15:52:39.504657 --- ParallelTerminationStrategy: PID 19224 died... 15:52:39.523175 run iperf3-srv_10.42.42.10(pid=19224): Terminated {rc=256} 15:52:39.566812 --- ParallelTerminationStrategy: PID 19225 died... 15:52:39.585237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19225): Terminated: ok {rc=0} 15:52:39.628655 --- ParallelTerminationStrategy: PID 19226 died... 15:52:39.647024 run iperf3-srv_10.42.42.10(pid=19226): Terminated {rc=256} 15:52:39.690623 --- ParallelTerminationStrategy: PID 19229 died... 15:52:39.709256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19229): Terminated: ok {rc=0} 15:52:39.753022 --- ParallelTerminationStrategy: PID 19234 died... 15:52:39.771453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19234): Terminated: ok {rc=0} 15:52:39.815257 --- ParallelTerminationStrategy: PID 19237 died... 15:52:39.833827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19237): Terminated: ok {rc=0} 15:52:39.919843 bus /gobi_0: Setting Powered False 15:52:41.019922 bus /gobi_0: Setting Powered False 15:52:42.133265 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 15:52:43.282511 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.294606 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:52:43.356423 tst iperf3.py: using LAC 22098 15:52:43.484473 tst iperf3.py: using RAC 168 15:52:43.611186 tst iperf3.py: using CellId 22098 15:52:43.737583 tst iperf3.py: using BVCI 22099 15:52:43.855005 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.866566 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.877660 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.888940 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.900148 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.911434 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.922951 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.934136 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:43.945581 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:52:44.064819 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:52:44.285849 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:44.611300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19239): Launched 15:52:44.895979 run iperf3-srv_10.42.42.10(pid=19240): Launched 15:52:45.018036 tst iperf3.py:8: start network... 15:52:45.237982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:45.739830 run create_hlr_db(pid=19241): Launched 15:52:45.880414 bus /gobi_6: Setting Powered False 15:52:46.967291 run create_hlr_db(pid=19241): Terminated: ok {rc=0} 15:52:47.454910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19243): Launched 15:52:47.759571 run osmo-hlr_10.42.42.2(pid=19244): Launched 15:52:47.874205 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:48.395588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19246): Launched 15:52:48.698433 run osmo-stp_10.42.42.5(pid=19247): Launched 15:52:48.817160 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:49.337655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19249): Launched 15:52:49.453843 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:49.707572 run patchelf(pid=19250): Launched 15:52:49.875923 run osmo-stp_10.42.42.5(pid=19247): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19247)] 15:52:50.004207 run osmo-stp_10.42.42.5(pid=19247): stdout: | (launched: 2022-12-09_15:52:48.643188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:50.134176 run osmo-stp_10.42.42.5(pid=19247): stderr: | [0;m[38;5;43m20221209155248808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155248808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155248808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155248809 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155248809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155248809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155248810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:50.264433 run osmo-stp_10.42.42.5(pid=19247): stdout: | (launched: 2022-12-09_15:52:48.643188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:50.387757 run osmo-stp_10.42.42.5(pid=19247): stderr: | [0;m[38;5;43m20221209155248808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155248808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155248808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155248809 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155248809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155248809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155248810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:50.533758 run patchelf(pid=19250): Terminating (SIGINT) 15:52:50.703635 run patchelf(pid=19250): Terminated: ok {rc=0} 15:52:50.827062 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19247): Process ended prematurely: osmo-stp_10.42.42.5(pid=19247) [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19247)] [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 15:52:50.836527 tst iperf3.py:8: Test FAILED (7.6 sec) 15:52:50.863599 run osmo-hlr_10.42.42.2(pid=19244): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19244)] 15:52:50.911903 run osmo-hlr_10.42.42.2(pid=19244): stdout: | (launched: 2022-12-09_15:52:47.704029) 15:52:50.961538 run osmo-hlr_10.42.42.2(pid=19244): stderr: | [0;m[1;31m20221209155247878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155247878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155247878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155247878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155247878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155247878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155247891 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155247899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155247899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155247899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:51.011486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19239): Terminating (SIGTERM) 15:52:51.051465 run iperf3-srv_10.42.42.10(pid=19240): Terminating (SIGTERM) 15:52:51.091344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19243): Terminating (SIGTERM) 15:52:51.131427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19246): Terminating (SIGTERM) 15:52:51.171300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19249): Terminating (SIGTERM) 15:52:51.211417 --- ParallelTerminationStrategy: PID 19239 died... 15:52:51.230573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19239): Terminated: ok {rc=0} 15:52:51.274877 --- ParallelTerminationStrategy: PID 19240 died... 15:52:51.293531 run iperf3-srv_10.42.42.10(pid=19240): Terminated {rc=256} 15:52:51.337718 --- ParallelTerminationStrategy: PID 19243 died... 15:52:51.356199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19243): Terminated: ok {rc=0} 15:52:51.400545 --- ParallelTerminationStrategy: PID 19246 died... 15:52:51.419226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19246): Terminated: ok {rc=0} 15:52:51.463211 --- ParallelTerminationStrategy: PID 19249 died... 15:52:51.481760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19249): Terminated: ok {rc=0} 15:52:51.567863 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 15:52:52.715136 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:52.726609 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:52:52.787799 tst iperf3m4.py: using LAC 22099 15:52:52.906178 tst iperf3m4.py: using RAC 169 15:52:53.022119 tst iperf3m4.py: using CellId 22099 15:52:53.138667 tst iperf3m4.py: using BVCI 22100 15:52:53.248940 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:53.259935 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:53.270686 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:53.281372 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:53.291910 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:53.302512 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:53.313382 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:53.323921 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:52:53.334631 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:52:53.455950 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:52:53.579129 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:52:53.696514 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:52:53.816313 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:52:54.036404 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:54.361891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19251): Launched 15:52:54.646968 run iperf3-srv_10.42.42.10(pid=19252): Launched 15:52:54.769619 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:52:54.988677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:55.315830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19253): Launched 15:52:55.599468 run iperf3-srv_10.42.42.10(pid=19254): Launched 15:52:55.722388 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:52:55.942114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:56.269625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19255): Launched 15:52:56.552580 run iperf3-srv_10.42.42.10(pid=19256): Launched 15:52:56.675332 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:52:56.894566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:57.221627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19257): Launched 15:52:57.504389 run iperf3-srv_10.42.42.10(pid=19258): Launched 15:52:57.626878 tst iperf3m4.py:8: start network... 15:52:57.847315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:58.350596 run create_hlr_db(pid=19259): Launched 15:52:58.475505 bus /gobi_6: Setting Powered False 15:52:59.539176 run create_hlr_db(pid=19259): Terminated: ok {rc=0} 15:52:59.973258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19261): Launched 15:53:00.277109 run osmo-hlr_10.42.42.2(pid=19262): Launched 15:53:00.393129 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:00.941759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19264): Launched 15:53:01.267611 run osmo-stp_10.42.42.5(pid=19265): Launched 15:53:01.593252 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:02.213890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19291): Launched 15:53:02.365812 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:02.655190 run patchelf(pid=19304): Launched 15:53:02.871707 run osmo-stp_10.42.42.5(pid=19265): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19265)] 15:53:03.012899 run osmo-stp_10.42.42.5(pid=19265): stdout: | (launched: 2022-12-09_15:53:01.209758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:03.171901 run osmo-stp_10.42.42.5(pid=19265): stderr: | [0;m[38;5;43m20221209155301457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155301458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155301459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155301460 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155301461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155301461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155301462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:03.334929 run osmo-stp_10.42.42.5(pid=19265): stdout: | (launched: 2022-12-09_15:53:01.209758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:03.494395 run osmo-stp_10.42.42.5(pid=19265): stderr: | [0;m[38;5;43m20221209155301457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155301458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155301459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155301460 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155301461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155301461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155301462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:03.693538 run patchelf(pid=19304): Terminating (SIGINT) 15:53:03.915395 run patchelf(pid=19304): Terminated: ok {rc=0} 15:53:04.078029 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19265): Process ended prematurely: osmo-stp_10.42.42.5(pid=19265) [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19265)] [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 15:53:04.088531 tst iperf3m4.py:8: Test FAILED (11.4 sec) 15:53:04.127572 run osmo-hlr_10.42.42.2(pid=19262): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19262)] 15:53:04.189528 run osmo-hlr_10.42.42.2(pid=19262): stdout: | (launched: 2022-12-09_15:53:00.221750) 15:53:04.253203 run osmo-hlr_10.42.42.2(pid=19262): stderr: | [0;m[1;31m20221209155300393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155300393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155300394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155300394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155300394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155300394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155300404 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155300413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155300413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155300413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:04.321264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19251): Terminating (SIGTERM) 15:53:04.373291 run iperf3-srv_10.42.42.10(pid=19252): Terminating (SIGTERM) 15:53:04.429203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19253): Terminating (SIGTERM) 15:53:04.483794 run iperf3-srv_10.42.42.10(pid=19254): Terminating (SIGTERM) 15:53:04.531328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19255): Terminating (SIGTERM) 15:53:04.581421 run iperf3-srv_10.42.42.10(pid=19256): Terminating (SIGTERM) 15:53:04.631046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19257): Terminating (SIGTERM) 15:53:04.678698 run iperf3-srv_10.42.42.10(pid=19258): Terminating (SIGTERM) 15:53:04.732702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19261): Terminating (SIGTERM) 15:53:04.790989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19264): Terminating (SIGTERM) 15:53:04.847016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19291): Terminating (SIGTERM) 15:53:04.902176 --- ParallelTerminationStrategy: PID 19251 died... 15:53:04.923329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19251): Terminated: ok {rc=0} 15:53:04.974442 --- ParallelTerminationStrategy: PID 19252 died... 15:53:04.994684 run iperf3-srv_10.42.42.10(pid=19252): Terminated {rc=256} 15:53:05.045564 --- ParallelTerminationStrategy: PID 19253 died... 15:53:05.066089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19253): Terminated: ok {rc=0} 15:53:05.116804 --- ParallelTerminationStrategy: PID 19254 died... 15:53:05.137239 run iperf3-srv_10.42.42.10(pid=19254): Terminated {rc=256} 15:53:05.187605 --- ParallelTerminationStrategy: PID 19255 died... 15:53:05.208260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19255): Terminated: ok {rc=0} 15:53:05.259012 --- ParallelTerminationStrategy: PID 19256 died... 15:53:05.280103 run iperf3-srv_10.42.42.10(pid=19256): Terminated {rc=256} 15:53:05.330003 --- ParallelTerminationStrategy: PID 19257 died... 15:53:05.350205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19257): Terminated: ok {rc=0} 15:53:05.400356 --- ParallelTerminationStrategy: PID 19258 died... 15:53:05.426007 run iperf3-srv_10.42.42.10(pid=19258): Terminated {rc=256} 15:53:05.475806 --- ParallelTerminationStrategy: PID 19261 died... 15:53:05.496379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19261): Terminated: ok {rc=0} 15:53:05.546303 --- ParallelTerminationStrategy: PID 19264 died... 15:53:05.567163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19264): Terminated: ok {rc=0} 15:53:05.617104 --- ParallelTerminationStrategy: PID 19291 died... 15:53:05.638865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19291): Terminated: ok {rc=0} 15:53:05.734557 bus /gobi_4: Setting Powered False 15:53:06.833656 bus /gobi_4: Setting Powered False 15:53:07.949329 bus /gobi_1: Setting Powered False 15:53:09.047866 bus /gobi_1: Setting Powered False 15:53:10.163652 bus /gobi_0: Setting Powered False 15:53:11.265348 bus /gobi_0: Setting Powered False 15:53:12.383075 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 15:53:13.489725 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:13.502665 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:53:13.561268 tst ping.py: using LAC 22100 15:53:13.682343 tst ping.py: using RAC 170 15:53:13.804356 tst ping.py: using CellId 22100 15:53:13.926439 tst ping.py: using BVCI 22101 15:53:14.039232 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:14.051372 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:14.063111 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:14.075439 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:14.088769 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:14.101161 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:14.113045 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:14.125485 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:53:14.246914 tst ping.py:19: start network... 15:53:14.457421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:14.938213 run create_hlr_db(pid=19540): Launched 15:53:15.100924 bus /gobi_6: Setting Powered False 15:53:16.180755 run create_hlr_db(pid=19540): Terminated: ok {rc=0} 15:53:16.762210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19542): Launched 15:53:17.108555 run osmo-hlr_10.42.42.2(pid=19543): Launched 15:53:17.400236 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:18.076163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19545): Launched 15:53:18.405721 run osmo-stp_10.42.42.5(pid=19546): Launched 15:53:18.537826 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:19.228860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19548): Launched 15:53:19.365659 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:19.644047 run patchelf(pid=19549): Launched 15:53:19.840360 run osmo-stp_10.42.42.5(pid=19546): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19546)] 15:53:19.980530 run osmo-stp_10.42.42.5(pid=19546): stdout: | (launched: 2022-12-09_15:53:18.342817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:20.123504 run osmo-stp_10.42.42.5(pid=19546): stderr: | [0;m[38;5;43m20221209155318695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155318695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155318695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155318696 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155318696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155318696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155318696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:20.266039 run osmo-stp_10.42.42.5(pid=19546): stdout: | (launched: 2022-12-09_15:53:18.342817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:20.402570 run osmo-stp_10.42.42.5(pid=19546): stderr: | [0;m[38;5;43m20221209155318695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155318695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155318695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155318696 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155318696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155318696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155318696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:20.564681 run patchelf(pid=19549): Terminating (SIGINT) 15:53:20.750627 run patchelf(pid=19549): Terminated: ok {rc=0} 15:53:20.884846 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19546): Process ended prematurely: osmo-stp_10.42.42.5(pid=19546) [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19546)] [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 15:53:20.895798 tst ping.py:22: Test FAILED (7.4 sec) 15:53:20.927936 run osmo-hlr_10.42.42.2(pid=19543): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19543)] 15:53:20.981848 run osmo-hlr_10.42.42.2(pid=19543): stdout: | (launched: 2022-12-09_15:53:17.043080) 15:53:21.037658 run osmo-hlr_10.42.42.2(pid=19543): stderr: | [0;m[1;31m20221209155317347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155317347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155317347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155317347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155317347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155317347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155317370 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155317388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155317388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155317388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:21.094157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19542): Terminating (SIGTERM) 15:53:21.140020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19545): Terminating (SIGTERM) 15:53:21.187664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19548): Terminating (SIGTERM) 15:53:21.235084 --- ParallelTerminationStrategy: PID 19542 died... 15:53:21.256653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19542): Terminated: ok {rc=0} 15:53:21.309141 --- ParallelTerminationStrategy: PID 19545 died... 15:53:21.330184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19545): Terminated: ok {rc=0} 15:53:21.380865 --- ParallelTerminationStrategy: PID 19548 died... 15:53:21.401845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19548): Terminated: ok {rc=0} 15:53:21.496019 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 15:53:22.591173 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:22.604279 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:53:22.668765 tst ping_idle_ping.py: using LAC 22101 15:53:22.798294 tst ping_idle_ping.py: using RAC 171 15:53:22.929136 tst ping_idle_ping.py: using CellId 22101 15:53:23.059126 tst ping_idle_ping.py: using BVCI 22102 15:53:23.181607 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:23.194001 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:23.207351 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:23.221029 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:23.234317 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:23.247449 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:23.262381 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:53:23.275668 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:53:23.401536 tst ping_idle_ping.py:24: start network... 15:53:23.627587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:24.146212 run create_hlr_db(pid=19550): Launched 15:53:24.312580 bus /gobi_6: Setting Powered False 15:53:25.378347 run create_hlr_db(pid=19550): Terminated: ok {rc=0} 15:53:25.847505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19552): Launched 15:53:26.161757 run osmo-hlr_10.42.42.2(pid=19555): Launched 15:53:26.275723 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:26.807521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19557): Launched 15:53:27.109187 run osmo-stp_10.42.42.5(pid=19558): Launched 15:53:27.223595 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:27.741510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19560): Launched 15:53:27.856188 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:28.110140 run patchelf(pid=19561): Launched 15:53:28.279814 run osmo-stp_10.42.42.5(pid=19558): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19558)] 15:53:28.407233 run osmo-stp_10.42.42.5(pid=19558): stdout: | (launched: 2022-12-09_15:53:27.053372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:28.536566 run osmo-stp_10.42.42.5(pid=19558): stderr: | [0;m[38;5;43m20221209155327222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155327222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155327222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155327223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155327223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155327223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155327223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:28.665716 run osmo-stp_10.42.42.5(pid=19558): stdout: | (launched: 2022-12-09_15:53:27.053372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:28.788730 run osmo-stp_10.42.42.5(pid=19558): stderr: | [0;m[38;5;43m20221209155327222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155327222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155327222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155327223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155327223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155327223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155327223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:28.934610 run patchelf(pid=19561): Terminating (SIGINT) 15:53:29.103191 run patchelf(pid=19561): Terminated: ok {rc=0} 15:53:29.224508 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19558): Process ended prematurely: osmo-stp_10.42.42.5(pid=19558) [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19558)] [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 15:53:29.233530 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 15:53:29.260305 run osmo-hlr_10.42.42.2(pid=19555): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19555)] 15:53:29.307809 run osmo-hlr_10.42.42.2(pid=19555): stdout: | (launched: 2022-12-09_15:53:26.106474) 15:53:29.357507 run osmo-hlr_10.42.42.2(pid=19555): stderr: | [0;m[1;31m20221209155326280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155326280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155326281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155326281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155326281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155326281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155326292 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155326302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155326302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155326302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:29.407294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19552): Terminating (SIGTERM) 15:53:29.447095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19557): Terminating (SIGTERM) 15:53:29.486962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19560): Terminating (SIGTERM) 15:53:29.527289 --- ParallelTerminationStrategy: PID 19552 died... 15:53:29.546497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19552): Terminated: ok {rc=0} 15:53:29.590846 --- ParallelTerminationStrategy: PID 19557 died... 15:53:29.609647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19557): Terminated: ok {rc=0} 15:53:29.653629 --- ParallelTerminationStrategy: PID 19560 died... 15:53:29.672420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19560): Terminated: ok {rc=0} 15:53:29.757289 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:53:31.070299 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:53:31.077111 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:53:31.098790 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 15:53:31.138430 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 15:53:31.226528 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:53:31.248058 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 15:53:31.288204 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 15:53:31.890474 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 15:53:31.951800 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:31.964236 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:53:32.024349 tst cs_paging_gprs_active.py: using LAC 22102 15:53:32.189260 tst cs_paging_gprs_active.py: using RAC 172 15:53:32.327858 tst cs_paging_gprs_active.py: using CellId 22102 15:53:32.447798 tst cs_paging_gprs_active.py: using BVCI 22103 15:53:32.558889 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:32.569860 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:32.580443 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:32.591092 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:32.601629 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:32.612202 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:32.623025 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:32.633612 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:32.644289 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:53:32.764921 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:53:32.889728 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:53:33.113754 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:33.445141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19565): Launched 15:53:33.732868 run iperf3-srv_10.42.42.10(pid=19566): Launched 15:53:33.856134 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:53:34.078400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:34.407729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19567): Launched 15:53:34.693824 run iperf3-srv_10.42.42.10(pid=19568): Launched 15:53:34.816876 tst cs_paging_gprs_active.py:38: start network... 15:53:35.037627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:35.544571 run create_hlr_db(pid=19569): Launched 15:53:35.671665 bus /gobi_6: Setting Powered False 15:53:36.736921 run create_hlr_db(pid=19569): Terminated: ok {rc=0} 15:53:37.177368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19571): Launched 15:53:37.484469 run osmo-hlr_10.42.42.2(pid=19572): Launched 15:53:37.603680 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:38.144832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19574): Launched 15:53:38.452562 run osmo-stp_10.42.42.5(pid=19575): Launched 15:53:38.569934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:39.097665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19577): Launched 15:53:39.219181 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:39.479848 run patchelf(pid=19578): Launched 15:53:39.651249 run osmo-stp_10.42.42.5(pid=19575): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19575)] 15:53:39.781250 run osmo-stp_10.42.42.5(pid=19575): stdout: | (launched: 2022-12-09_15:53:38.396308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:39.912662 run osmo-stp_10.42.42.5(pid=19575): stderr: | [0;m[38;5;43m20221209155338564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155338564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155338564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155338565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155338565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155338565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155338565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:40.044333 run osmo-stp_10.42.42.5(pid=19575): stdout: | (launched: 2022-12-09_15:53:38.396308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:40.169127 run osmo-stp_10.42.42.5(pid=19575): stderr: | [0;m[38;5;43m20221209155338564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155338564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155338564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155338565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155338565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155338565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155338565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:40.317163 run patchelf(pid=19578): Terminating (SIGINT) 15:53:40.489671 run patchelf(pid=19578): Terminated: ok {rc=0} 15:53:40.614055 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19575): Process ended prematurely: osmo-stp_10.42.42.5(pid=19575) [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19575)] [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 15:53:40.623475 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 15:53:40.650411 run osmo-hlr_10.42.42.2(pid=19572): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19572)] 15:53:40.697907 run osmo-hlr_10.42.42.2(pid=19572): stdout: | (launched: 2022-12-09_15:53:37.428472) 15:53:40.746902 run osmo-hlr_10.42.42.2(pid=19572): stderr: | [0;m[1;31m20221209155337604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155337604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155337604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155337604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155337604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155337604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155337616 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155337624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155337625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155337625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:40.796480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19565): Terminating (SIGTERM) 15:53:40.836191 run iperf3-srv_10.42.42.10(pid=19566): Terminating (SIGTERM) 15:53:40.875650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19567): Terminating (SIGTERM) 15:53:40.915182 run iperf3-srv_10.42.42.10(pid=19568): Terminating (SIGTERM) 15:53:40.954687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19571): Terminating (SIGTERM) 15:53:40.994272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19574): Terminating (SIGTERM) 15:53:41.033857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19577): Terminating (SIGTERM) 15:53:41.073502 --- ParallelTerminationStrategy: PID 19565 died... 15:53:41.092498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19565): Terminated: ok {rc=0} 15:53:41.136288 --- ParallelTerminationStrategy: PID 19566 died... 15:53:41.154591 run iperf3-srv_10.42.42.10(pid=19566): Terminated {rc=256} 15:53:41.198155 --- ParallelTerminationStrategy: PID 19567 died... 15:53:41.216678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19567): Terminated: ok {rc=0} 15:53:41.260627 --- ParallelTerminationStrategy: PID 19568 died... 15:53:41.279124 run iperf3-srv_10.42.42.10(pid=19568): Terminated {rc=256} 15:53:41.323328 --- ParallelTerminationStrategy: PID 19571 died... 15:53:41.341893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19571): Terminated: ok {rc=0} 15:53:41.385760 --- ParallelTerminationStrategy: PID 19574 died... 15:53:41.404275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19574): Terminated: ok {rc=0} 15:53:41.448109 --- ParallelTerminationStrategy: PID 19577 died... 15:53:41.466772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19577): Terminated: ok {rc=0} 15:53:41.551807 bus /gobi_0: Setting Powered False 15:53:42.653709 bus /gobi_0: Setting Powered False 15:53:43.770823 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 15:53:44.921642 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:44.933929 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:53:44.996016 tst iperf3.py: using LAC 22103 15:53:45.124525 tst iperf3.py: using RAC 173 15:53:45.251347 tst iperf3.py: using CellId 22103 15:53:45.378113 tst iperf3.py: using BVCI 22104 15:53:45.495993 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.507763 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.518987 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.530725 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.542155 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.553635 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.565464 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.577070 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:45.588822 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:53:45.708272 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:53:45.917886 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:46.232372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19579): Launched 15:53:46.518991 run iperf3-srv_10.42.42.10(pid=19580): Launched 15:53:46.658491 tst iperf3.py:8: start network... 15:53:46.871108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:47.352317 run create_hlr_db(pid=19581): Launched 15:53:47.478662 bus /gobi_6: Setting Powered False 15:53:48.539464 run create_hlr_db(pid=19581): Terminated: ok {rc=0} 15:53:48.987138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19583): Launched 15:53:49.316151 run osmo-hlr_10.42.42.2(pid=19584): Launched 15:53:49.441569 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:50.003336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19586): Launched 15:53:50.330857 run osmo-stp_10.42.42.5(pid=19587): Launched 15:53:50.455147 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:51.019002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19589): Launched 15:53:51.146851 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:51.424879 run patchelf(pid=19590): Launched 15:53:51.607888 run osmo-stp_10.42.42.5(pid=19587): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19587)] 15:53:51.747558 run osmo-stp_10.42.42.5(pid=19587): stdout: | (launched: 2022-12-09_15:53:50.271042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:51.888187 run osmo-stp_10.42.42.5(pid=19587): stderr: | [0;m[38;5;43m20221209155350462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155350462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155350462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155350463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155350463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155350463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155350463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:52.028919 run osmo-stp_10.42.42.5(pid=19587): stdout: | (launched: 2022-12-09_15:53:50.271042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:52.163207 run osmo-stp_10.42.42.5(pid=19587): stderr: | [0;m[38;5;43m20221209155350462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155350462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155350462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155350463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155350463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155350463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155350463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:52.322457 run patchelf(pid=19590): Terminating (SIGINT) 15:53:52.506138 run patchelf(pid=19590): Terminated: ok {rc=0} 15:53:52.639270 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19587): Process ended prematurely: osmo-stp_10.42.42.5(pid=19587) [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19587)] [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 15:53:52.649849 tst iperf3.py:8: Test FAILED (7.8 sec) 15:53:52.679364 run osmo-hlr_10.42.42.2(pid=19584): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19584)] 15:53:52.730502 run osmo-hlr_10.42.42.2(pid=19584): stdout: | (launched: 2022-12-09_15:53:49.256476) 15:53:52.783610 run osmo-hlr_10.42.42.2(pid=19584): stderr: | [0;m[1;31m20221209155349454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155349454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155349454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155349454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155349454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155349454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155349467 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155349475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155349475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155349475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:52.836892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19579): Terminating (SIGTERM) 15:53:52.879624 run iperf3-srv_10.42.42.10(pid=19580): Terminating (SIGTERM) 15:53:52.922408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19583): Terminating (SIGTERM) 15:53:52.965092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19586): Terminating (SIGTERM) 15:53:53.007774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19589): Terminating (SIGTERM) 15:53:53.050659 --- ParallelTerminationStrategy: PID 19579 died... 15:53:53.070834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19579): Terminated: ok {rc=0} 15:53:53.118371 --- ParallelTerminationStrategy: PID 19580 died... 15:53:53.138110 run iperf3-srv_10.42.42.10(pid=19580): Terminated {rc=256} 15:53:53.185163 --- ParallelTerminationStrategy: PID 19583 died... 15:53:53.204804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19583): Terminated: ok {rc=0} 15:53:53.252070 --- ParallelTerminationStrategy: PID 19586 died... 15:53:53.271939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19586): Terminated: ok {rc=0} 15:53:53.319372 --- ParallelTerminationStrategy: PID 19589 died... 15:53:53.339306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19589): Terminated: ok {rc=0} 15:53:53.429256 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 15:53:54.580097 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:54.592465 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:53:54.652716 tst iperf3m4.py: using LAC 22104 15:53:54.783350 tst iperf3m4.py: using RAC 174 15:53:54.908356 tst iperf3m4.py: using CellId 22104 15:53:55.051230 tst iperf3m4.py: using BVCI 22105 15:53:55.170747 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:55.182531 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:55.193955 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:55.205944 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:55.217845 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:55.229611 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:55.241649 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:55.253295 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:53:55.264909 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:53:55.384608 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:53:55.506436 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:53:55.623508 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:53:55.742965 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:53:55.950969 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:56.258512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19591): Launched 15:53:56.526700 run iperf3-srv_10.42.42.10(pid=19592): Launched 15:53:56.641980 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:53:56.848348 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:57.156410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19593): Launched 15:53:57.425452 run iperf3-srv_10.42.42.10(pid=19594): Launched 15:53:57.540364 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:53:57.745479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:58.052643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19595): Launched 15:53:58.321168 run iperf3-srv_10.42.42.10(pid=19596): Launched 15:53:58.436860 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:53:58.642985 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:58.951745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19597): Launched 15:53:59.220579 run iperf3-srv_10.42.42.10(pid=19598): Launched 15:53:59.335941 tst iperf3m4.py:8: start network... 15:53:59.542406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:00.016811 run create_hlr_db(pid=19599): Launched 15:54:00.144684 bus /gobi_6: Setting Powered False 15:54:01.208888 run create_hlr_db(pid=19599): Terminated: ok {rc=0} 15:54:01.681453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19601): Launched 15:54:02.097756 run osmo-hlr_10.42.42.2(pid=19602): Launched 15:54:02.247422 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:02.791758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19604): Launched 15:54:03.099572 run osmo-stp_10.42.42.5(pid=19605): Launched 15:54:03.216199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:03.742514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19607): Launched 15:54:03.862567 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:04.121791 run patchelf(pid=19608): Launched 15:54:04.292315 run osmo-stp_10.42.42.5(pid=19605): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19605)] 15:54:04.421617 run osmo-stp_10.42.42.5(pid=19605): stdout: | (launched: 2022-12-09_15:54:03.043177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:04.552563 run osmo-stp_10.42.42.5(pid=19605): stderr: | [0;m[38;5;43m20221209155403210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155403210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155403210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155403210 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155403211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155403211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155403211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:04.683377 run osmo-stp_10.42.42.5(pid=19605): stdout: | (launched: 2022-12-09_15:54:03.043177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:04.807932 run osmo-stp_10.42.42.5(pid=19605): stderr: | [0;m[38;5;43m20221209155403210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155403210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155403210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155403210 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155403211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155403211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155403211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:04.955534 run patchelf(pid=19608): Terminating (SIGINT) 15:54:05.127007 run patchelf(pid=19608): Terminated: ok {rc=0} 15:54:05.251082 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19605): Process ended prematurely: osmo-stp_10.42.42.5(pid=19605) [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19605)] [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 15:54:05.260519 tst iperf3m4.py:8: Test FAILED (10.7 sec) 15:54:05.288267 run osmo-hlr_10.42.42.2(pid=19602): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19602)] 15:54:05.336125 run osmo-hlr_10.42.42.2(pid=19602): stdout: | (launched: 2022-12-09_15:54:02.031698) 15:54:05.386077 run osmo-hlr_10.42.42.2(pid=19602): stderr: | [0;m[1;31m20221209155402330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155402330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155402330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155402330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155402330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155402330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155402343 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155402353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155402353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155402353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:05.436437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19591): Terminating (SIGTERM) 15:54:05.476132 run iperf3-srv_10.42.42.10(pid=19592): Terminating (SIGTERM) 15:54:05.516055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19593): Terminating (SIGTERM) 15:54:05.556046 run iperf3-srv_10.42.42.10(pid=19594): Terminating (SIGTERM) 15:54:05.596094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19595): Terminating (SIGTERM) 15:54:05.636159 run iperf3-srv_10.42.42.10(pid=19596): Terminating (SIGTERM) 15:54:05.676121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19597): Terminating (SIGTERM) 15:54:05.715827 run iperf3-srv_10.42.42.10(pid=19598): Terminating (SIGTERM) 15:54:05.755360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19601): Terminating (SIGTERM) 15:54:05.795267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19604): Terminating (SIGTERM) 15:54:05.835083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19607): Terminating (SIGTERM) 15:54:05.875019 --- ParallelTerminationStrategy: PID 19591 died... 15:54:05.894109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19591): Terminated: ok {rc=0} 15:54:05.938430 --- ParallelTerminationStrategy: PID 19592 died... 15:54:05.957040 run iperf3-srv_10.42.42.10(pid=19592): Terminated {rc=256} 15:54:06.001046 --- ParallelTerminationStrategy: PID 19593 died... 15:54:06.019736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19593): Terminated: ok {rc=0} 15:54:06.063727 --- ParallelTerminationStrategy: PID 19594 died... 15:54:06.082302 run iperf3-srv_10.42.42.10(pid=19594): Terminated {rc=256} 15:54:06.126052 --- ParallelTerminationStrategy: PID 19595 died... 15:54:06.144667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19595): Terminated: ok {rc=0} 15:54:06.188508 --- ParallelTerminationStrategy: PID 19596 died... 15:54:06.206950 run iperf3-srv_10.42.42.10(pid=19596): Terminated {rc=256} 15:54:06.251237 --- ParallelTerminationStrategy: PID 19597 died... 15:54:06.269860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19597): Terminated: ok {rc=0} 15:54:06.313566 --- ParallelTerminationStrategy: PID 19598 died... 15:54:06.332169 run iperf3-srv_10.42.42.10(pid=19598): Terminated {rc=256} 15:54:06.375762 --- ParallelTerminationStrategy: PID 19601 died... 15:54:06.394312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19601): Terminated: ok {rc=0} 15:54:06.438397 --- ParallelTerminationStrategy: PID 19604 died... 15:54:06.457107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19604): Terminated: ok {rc=0} 15:54:06.500806 --- ParallelTerminationStrategy: PID 19607 died... 15:54:06.519625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19607): Terminated: ok {rc=0} 15:54:06.603782 bus /gobi_4: Setting Powered False 15:54:07.703272 bus /gobi_4: Setting Powered False 15:54:08.823896 bus /gobi_1: Setting Powered False 15:54:09.922682 bus /gobi_1: Setting Powered False 15:54:11.039085 bus /gobi_0: Setting Powered False 15:54:12.139669 bus /gobi_0: Setting Powered False 15:54:13.255693 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 15:54:14.359280 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:14.371017 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:54:14.429089 tst ping.py: using LAC 22105 15:54:14.548388 tst ping.py: using RAC 175 15:54:14.665646 tst ping.py: using CellId 22105 15:54:14.793231 tst ping.py: using BVCI 22106 15:54:14.910588 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:14.922337 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:14.934147 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:14.946459 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:14.958644 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:14.970668 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:14.983064 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:14.995122 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:54:15.118810 tst ping.py:19: start network... 15:54:15.338819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:15.845892 run create_hlr_db(pid=19609): Launched 15:54:16.048039 bus /gobi_6: Setting Powered False 15:54:17.108600 run create_hlr_db(pid=19609): Terminated: ok {rc=0} 15:54:17.536252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19611): Launched 15:54:17.837818 run osmo-hlr_10.42.42.2(pid=19612): Launched 15:54:17.951910 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:18.486892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19614): Launched 15:54:18.789822 run osmo-stp_10.42.42.5(pid=19615): Launched 15:54:18.903794 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:19.419472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19618): Launched 15:54:19.536143 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:19.790367 run patchelf(pid=19619): Launched 15:54:19.959868 run osmo-stp_10.42.42.5(pid=19615): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19615)] 15:54:20.086934 run osmo-stp_10.42.42.5(pid=19615): stdout: | (launched: 2022-12-09_15:54:18.734625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:20.215951 run osmo-stp_10.42.42.5(pid=19615): stderr: | [0;m[38;5;43m20221209155418905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155418905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155418905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155418905 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155418906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155418906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155418906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:20.345660 run osmo-stp_10.42.42.5(pid=19615): stdout: | (launched: 2022-12-09_15:54:18.734625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:20.468858 run osmo-stp_10.42.42.5(pid=19615): stderr: | [0;m[38;5;43m20221209155418905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155418905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155418905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155418905 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155418906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155418906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155418906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:20.614610 run patchelf(pid=19619): Terminating (SIGINT) 15:54:20.782530 run patchelf(pid=19619): Terminated: ok {rc=0} 15:54:20.904271 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19615): Process ended prematurely: osmo-stp_10.42.42.5(pid=19615) [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19615)] [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 15:54:20.913498 tst ping.py:22: Test FAILED (6.5 sec) 15:54:20.940334 run osmo-hlr_10.42.42.2(pid=19612): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19612)] 15:54:20.988025 run osmo-hlr_10.42.42.2(pid=19612): stdout: | (launched: 2022-12-09_15:54:17.782487) 15:54:21.037601 run osmo-hlr_10.42.42.2(pid=19612): stderr: | [0;m[1;31m20221209155417956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155417956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155417956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155417956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155417956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155417956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155417968 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155417977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155417978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155417978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:21.087646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19611): Terminating (SIGTERM) 15:54:21.127645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19614): Terminating (SIGTERM) 15:54:21.167446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19618): Terminating (SIGTERM) 15:54:21.207630 --- ParallelTerminationStrategy: PID 19611 died... 15:54:21.226521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19611): Terminated: ok {rc=0} 15:54:21.270991 --- ParallelTerminationStrategy: PID 19614 died... 15:54:21.289812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19614): Terminated: ok {rc=0} 15:54:21.334122 --- ParallelTerminationStrategy: PID 19618 died... 15:54:21.353130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19618): Terminated: ok {rc=0} 15:54:21.439777 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 15:54:22.527784 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:22.539649 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:54:22.601152 tst ping_idle_ping.py: using LAC 22106 15:54:22.718807 tst ping_idle_ping.py: using RAC 176 15:54:22.844764 tst ping_idle_ping.py: using CellId 22106 15:54:22.969067 tst ping_idle_ping.py: using BVCI 22107 15:54:23.085744 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:23.097202 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:23.108420 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:23.119840 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:23.131546 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:23.142857 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:23.154393 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:54:23.165810 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:54:23.285519 tst ping_idle_ping.py:24: start network... 15:54:23.504034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:24.011069 run create_hlr_db(pid=19621): Launched 15:54:24.133699 bus /gobi_6: Setting Powered False 15:54:25.194470 run create_hlr_db(pid=19621): Terminated: ok {rc=0} 15:54:25.646347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19623): Launched 15:54:25.970597 run osmo-hlr_10.42.42.2(pid=19624): Launched 15:54:26.093851 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:26.642891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19626): Launched 15:54:26.966698 run osmo-stp_10.42.42.5(pid=19627): Launched 15:54:27.091187 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:27.648695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19629): Launched 15:54:27.773757 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:28.047551 run patchelf(pid=19630): Launched 15:54:28.227561 run osmo-stp_10.42.42.5(pid=19627): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19627)] 15:54:28.364716 run osmo-stp_10.42.42.5(pid=19627): stdout: | (launched: 2022-12-09_15:54:26.908132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:28.503590 run osmo-stp_10.42.42.5(pid=19627): stderr: | [0;m[38;5;43m20221209155427098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155427098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155427098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155427099 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155427099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155427099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155427099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:28.643227 run osmo-stp_10.42.42.5(pid=19627): stdout: | (launched: 2022-12-09_15:54:26.908132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:28.776873 run osmo-stp_10.42.42.5(pid=19627): stderr: | [0;m[38;5;43m20221209155427098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155427098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155427098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155427099 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155427099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155427099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155427099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:28.934386 run patchelf(pid=19630): Terminating (SIGINT) 15:54:29.114556 run patchelf(pid=19630): Terminated: ok {rc=0} 15:54:29.245145 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19627): Process ended prematurely: osmo-stp_10.42.42.5(pid=19627) [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19627)] [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 15:54:29.254962 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 15:54:29.283917 run osmo-hlr_10.42.42.2(pid=19624): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19624)] 15:54:29.335057 run osmo-hlr_10.42.42.2(pid=19624): stdout: | (launched: 2022-12-09_15:54:25.911648) 15:54:29.387968 run osmo-hlr_10.42.42.2(pid=19624): stderr: | [0;m[1;31m20221209155426106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155426107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155426107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155426107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155426107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155426107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155426119 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155426128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155426128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155426128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:29.441487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19623): Terminating (SIGTERM) 15:54:29.484168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19626): Terminating (SIGTERM) 15:54:29.526815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19629): Terminating (SIGTERM) 15:54:29.569791 --- ParallelTerminationStrategy: PID 19623 died... 15:54:29.589996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19623): Terminated: ok {rc=0} 15:54:29.637808 --- ParallelTerminationStrategy: PID 19626 died... 15:54:29.657734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19626): Terminated: ok {rc=0} 15:54:29.705836 --- ParallelTerminationStrategy: PID 19629 died... 15:54:29.725681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19629): Terminated: ok {rc=0} 15:54:29.815814 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:54:31.133533 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:54:31.140097 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:54:31.161172 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 15:54:31.198275 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:54:31.256497 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:54:31.282405 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 15:54:31.325729 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:54:31.866845 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 15:54:31.871874 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:31.883416 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:54:31.942409 tst switch_tch_pdch.py: using LAC 22107 15:54:32.095810 tst switch_tch_pdch.py: using RAC 177 15:54:32.229633 tst switch_tch_pdch.py: using CellId 22107 15:54:32.366287 tst switch_tch_pdch.py: using BVCI 22108 15:54:32.484051 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:32.496012 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:32.507775 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:32.519851 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:32.532231 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:32.544271 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:32.556561 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:54:32.568521 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:54:32.687521 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:54:32.804614 tst switch_tch_pdch.py:51: start network... 15:54:33.006749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:33.472166 run create_hlr_db(pid=19634): Launched 15:54:33.596721 bus /gobi_6: Setting Powered False 15:54:34.657216 run create_hlr_db(pid=19634): Terminated: ok {rc=0} 15:54:35.097866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19636): Launched 15:54:35.419747 run osmo-hlr_10.42.42.2(pid=19637): Launched 15:54:35.542786 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:36.098148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19639): Launched 15:54:36.419459 run osmo-stp_10.42.42.5(pid=19640): Launched 15:54:36.544004 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:37.100292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19642): Launched 15:54:37.224292 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:37.496479 run patchelf(pid=19643): Launched 15:54:37.676384 run osmo-stp_10.42.42.5(pid=19640): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19640)] 15:54:37.813618 run osmo-stp_10.42.42.5(pid=19640): stdout: | (launched: 2022-12-09_15:54:36.360745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:37.951590 run osmo-stp_10.42.42.5(pid=19640): stderr: | [0;m[38;5;43m20221209155436552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155436552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155436552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155436552 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155436553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155436553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155436553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:38.089890 run osmo-stp_10.42.42.5(pid=19640): stdout: | (launched: 2022-12-09_15:54:36.360745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:38.221854 run osmo-stp_10.42.42.5(pid=19640): stderr: | [0;m[38;5;43m20221209155436552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155436552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155436552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155436552 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155436553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155436553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155436553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:38.378313 run patchelf(pid=19643): Terminating (SIGINT) 15:54:38.557508 run patchelf(pid=19643): Terminated: ok {rc=0} 15:54:38.687099 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19640): Process ended prematurely: osmo-stp_10.42.42.5(pid=19640) [trial-2361↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19640)] [trial-2361↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 15:54:38.696759 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 15:54:38.725695 run osmo-hlr_10.42.42.2(pid=19637): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19637)] 15:54:38.776496 run osmo-hlr_10.42.42.2(pid=19637): stdout: | (launched: 2022-12-09_15:54:35.360819) 15:54:38.828858 run osmo-hlr_10.42.42.2(pid=19637): stderr: | [0;m[1;31m20221209155435558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155435558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155435558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155435558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155435558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155435558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155435571 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155435581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155435581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155435581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:38.881725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19636): Terminating (SIGTERM) 15:54:38.924113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19639): Terminating (SIGTERM) 15:54:38.966880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19642): Terminating (SIGTERM) 15:54:39.009520 --- ParallelTerminationStrategy: PID 19636 died... 15:54:39.029650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19636): Terminated: ok {rc=0} 15:54:39.076379 --- ParallelTerminationStrategy: PID 19639 died... 15:54:39.095913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19639): Terminated: ok {rc=0} 15:54:39.142539 --- ParallelTerminationStrategy: PID 19642 died... 15:54:39.161975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19642): Terminated: ok {rc=0} 15:54:39.250632 bus /gobi_0: Setting Powered False 15:54:40.350362 bus /gobi_0: Setting Powered False 15:54:41.467271 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 15:54:42.708592 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:54:42.714400 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 15:54:42.735149 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 15:54:42.770032 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 15:54:42.822170 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 15:54:42.842634 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 15:54:42.877290 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 15:54:43.433895 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 15:54:43.439165 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:43.450260 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 15:54:43.505317 tst switch_tch_pdch.py: using LAC 22108 15:54:43.623474 tst switch_tch_pdch.py: using RAC 178 15:54:43.739879 tst switch_tch_pdch.py: using CellId 22108 15:54:43.855123 tst switch_tch_pdch.py: using BVCI 22109 15:54:43.963380 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:43.974354 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:43.985069 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:43.995972 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:44.006742 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:44.017504 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:44.028388 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:54:44.039348 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:54:44.159314 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:54:44.281403 tst switch_tch_pdch.py:51: start network... 15:54:44.500119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:44.972016 run create_hlr_db(pid=19647): Launched 15:54:45.096675 bus /gobi_6: Setting Powered False 15:54:46.158498 run create_hlr_db(pid=19647): Terminated: ok {rc=0} 15:54:46.588896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19649): Launched 15:54:46.999022 run osmo-hlr_10.42.42.2(pid=19650): Launched 15:54:47.177490 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:47.706780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19652): Launched 15:54:48.029112 run osmo-stp_10.42.42.5(pid=19653): Launched 15:54:48.152428 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:48.676624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19655): Launched 15:54:48.799826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:49.070937 run patchelf(pid=19656): Launched 15:54:49.250623 run osmo-stp_10.42.42.5(pid=19653): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19653)] 15:54:49.386045 run osmo-stp_10.42.42.5(pid=19653): stdout: | (launched: 2022-12-09_15:54:47.970966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:49.523387 run osmo-stp_10.42.42.5(pid=19653): stderr: | [0;m[38;5;43m20221209155448161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155448161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155448162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155448162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155448163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155448163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155448163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:49.660752 run osmo-stp_10.42.42.5(pid=19653): stdout: | (launched: 2022-12-09_15:54:47.970966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:49.793221 run osmo-stp_10.42.42.5(pid=19653): stderr: | [0;m[38;5;43m20221209155448161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155448161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155448162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155448162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155448163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155448163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155448163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:49.948621 run patchelf(pid=19656): Terminating (SIGINT) 15:54:50.127429 run patchelf(pid=19656): Terminated: ok {rc=0} 15:54:50.256375 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19653): Process ended prematurely: osmo-stp_10.42.42.5(pid=19653) [trial-2361↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19653)] [trial-2361↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 15:54:50.266127 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 15:54:50.294373 run osmo-hlr_10.42.42.2(pid=19650): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19650)] 15:54:50.344753 run osmo-hlr_10.42.42.2(pid=19650): stdout: | (launched: 2022-12-09_15:54:46.939962) 15:54:50.396458 run osmo-hlr_10.42.42.2(pid=19650): stderr: | [0;m[1;31m20221209155447246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155447246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155447246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155447246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155447247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155447247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155447264 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155447274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155447274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155447274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:50.448476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19649): Terminating (SIGTERM) 15:54:50.490702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19652): Terminating (SIGTERM) 15:54:50.532454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19655): Terminating (SIGTERM) 15:54:50.574446 --- ParallelTerminationStrategy: PID 19649 died... 15:54:50.594343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19649): Terminated: ok {rc=0} 15:54:50.640728 --- ParallelTerminationStrategy: PID 19652 died... 15:54:50.660075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19652): Terminated: ok {rc=0} 15:54:50.706850 --- ParallelTerminationStrategy: PID 19655 died... 15:54:50.726270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19655): Terminated: ok {rc=0} 15:54:50.814705 bus /gobi_0: Setting Powered False 15:54:51.914281 bus /gobi_0: Setting Powered False 15:54:53.030719 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_sms:trx-b200 --------------------------------------------------------------------- 15:54:54.268812 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:54:54.273267 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 15:54:54.308690 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 15:54:54.315968 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 15:54:54.370929 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 15:54:54.405730 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 15:54:54.412833 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 15:54:54.952557 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 15:54:54.958101 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 15:54:54.969483 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 15:54:55.022123 tst mo_mt_sms.py: using LAC 22109 15:54:55.149566 tst mo_mt_sms.py: using RAC 179 15:54:55.268848 tst mo_mt_sms.py: using CellId 22109 15:54:55.387850 tst mo_mt_sms.py: using BVCI 22110 15:54:55.496920 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 15:54:55.614850 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 15:54:55.730512 tst mo_mt_sms.py:9: start nitb and bts... 15:54:55.935487 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:54:56.549209 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19660): Launched 15:54:56.851004 run osmo-nitb_10.42.42.2(pid=19661): Launched 15:54:57.017839 run osmo-nitb_10.42.42.2(pid=19661): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19661)] 15:54:57.152872 run osmo-nitb_10.42.42.2(pid=19661): stdout: | (launched: 2022-12-09_15:54:56.795692) 15:54:57.290198 run osmo-nitb_10.42.42.2(pid=19661): stderr: | (launched: 2022-12-09_15:54:56.840716) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:54:57.426684 run osmo-nitb_10.42.42.2(pid=19661): stdout: | (launched: 2022-12-09_15:54:56.795692) 15:54:57.557438 run osmo-nitb_10.42.42.2(pid=19661): stderr: | (launched: 2022-12-09_15:54:56.840716) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19661): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19661) [trial-2361↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19661)] 15:54:57.964903 tst osmo-nitb_10.42.42.2(pid=19661): stdout: | (launched: 2022-12-09_15:54:56.795692) 15:54:58.085478 tst osmo-nitb_10.42.42.2(pid=19661): stderr: | (launched: 2022-12-09_15:54:56.840716) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:54:58.227741 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=19661): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19661) [trial-2361↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19661)] [trial-2361↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 15:54:58.236148 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 15:54:58.242745 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19660): Terminating (SIGTERM) 15:54:58.450967 --- ParallelTerminationStrategy: PID 19660 died... 15:54:58.471562 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19660): Terminated: ok {rc=0} 15:54:58.557821 bus /sierra_3: Setting Powered False 15:54:59.658354 bus /sierra_3: Setting Powered False 15:55:00.775877 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 sms:trx-b200 --------------------------------------------------------------------- 15:55:01.985818 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:55:01.994656 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 15:55:02.054009 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 15:55:02.091019 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 15:55:02.154348 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 15:55:02.196302 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 15:55:02.230702 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 15:55:02.759525 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 15:55:02.764740 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:02.775597 tst sms:trx-b200: Using 1 x bts (candidates: 1) 15:55:02.825238 tst mo_mt_sms.py: using LAC 22110 15:55:02.943595 tst mo_mt_sms.py: using RAC 180 15:55:03.061469 tst mo_mt_sms.py: using CellId 22110 15:55:03.181457 tst mo_mt_sms.py: using BVCI 22111 15:55:03.290174 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:03.300993 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:03.311534 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:03.322553 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:03.333707 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:03.344488 tst sms:trx-b200: Using 1 x modem (candidates: 2) 15:55:03.465978 tst sms:trx-b200: Using 1 x modem (candidates: 2) 15:55:03.586743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:55:04.084126 run create_hlr_db(pid=19669): Launched 15:55:04.207485 bus /sierra_2: Setting Powered False 15:55:05.270910 run create_hlr_db(pid=19669): Terminated: ok {rc=0} 15:55:05.702279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19671): Launched 15:55:06.004097 run osmo-hlr_10.42.42.2(pid=19672): Launched 15:55:06.121133 run osmo-stp_10.42.42.5: Starting osmo-stp 15:55:06.651597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19674): Launched 15:55:06.951390 run osmo-stp_10.42.42.5(pid=19675): Launched 15:55:07.065567 run osmo-msc_10.42.42.6: Starting osmo-msc 15:55:07.608623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19677): Launched 15:55:07.909951 run osmo-msc_10.42.42.6(pid=19678): Launched 15:55:08.077616 run osmo-stp_10.42.42.5(pid=19675): ERR: Terminated: ERROR {rc=1} [trial-2361↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19675)] 15:55:08.203471 run osmo-stp_10.42.42.5(pid=19675): stdout: | (launched: 2022-12-09_15:55:06.896120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:08.329614 run osmo-stp_10.42.42.5(pid=19675): stderr: | [0;m[38;5;43m20221209155507065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155507065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155507066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155507066 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155507066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155507067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155507067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:08.453793 run osmo-stp_10.42.42.5(pid=19675): stdout: | (launched: 2022-12-09_15:55:06.896120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:08.572862 run osmo-stp_10.42.42.5(pid=19675): stderr: | [0;m[38;5;43m20221209155507065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155507065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155507066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155507066 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155507066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155507067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155507067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:08.715697 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=19675): Process ended prematurely: osmo-stp_10.42.42.5(pid=19675) [trial-2361↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19675)] [trial-2361↪sms:trx-b200↪mo_mt_sms.py:16] 15:55:08.723925 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 15:55:08.750095 run osmo-hlr_10.42.42.2(pid=19672): ERR: Terminated: ERROR {rc=237} [trial-2361↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19672)] 15:55:08.797555 run osmo-hlr_10.42.42.2(pid=19672): stdout: | (launched: 2022-12-09_15:55:05.948918) 15:55:08.846633 run osmo-hlr_10.42.42.2(pid=19672): stderr: | [0;m[1;31m20221209155506122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155506122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155506122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155506123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155506123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155506123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155506135 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155506143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155506143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155506143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:55:08.915075 run osmo-msc_10.42.42.6(pid=19678): ERR: Terminated: ERROR {rc=2} [trial-2361↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19678)] 15:55:08.962598 run osmo-msc_10.42.42.6(pid=19678): stdout: | (launched: 2022-12-09_15:55:07.854156) 15:55:09.011503 run osmo-msc_10.42.42.6(pid=19678): stderr: | [0;m[38;5;43m20221209155508124 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155508124 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f144b388c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155508124 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155508125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155508125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155508125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155508127 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155508128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155508128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155508128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:55:09.060507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19671): Terminating (SIGTERM) 15:55:09.099936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19674): Terminating (SIGTERM) 15:55:09.139549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19677): Terminating (SIGTERM) 15:55:09.179123 --- ParallelTerminationStrategy: PID 19671 died... 15:55:09.198195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19671): Terminated: ok {rc=0} 15:55:09.241894 --- ParallelTerminationStrategy: PID 19674 died... 15:55:09.260355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19674): Terminated: ok {rc=0} 15:55:09.303876 --- ParallelTerminationStrategy: PID 19677 died... 15:55:09.322263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19677): Terminated: ok {rc=0} 15:55:09.405949 bus /sierra_3: Setting Powered False 15:55:10.503771 bus /sierra_3: Setting Powered False 15:55:11.620620 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_ussd:trx-b200 --------------------------------------------------------------------- 15:55:12.852889 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:55:12.857223 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 15:55:12.891949 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 15:55:12.898978 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 15:55:12.935931 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 15:55:12.970395 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 15:55:12.977452 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 15:55:13.497019 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2361 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 15:55:13.502151 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 15:55:13.513423 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 15:55:13.562565 tst assert_extension.py: using LAC 22111 15:55:13.693453 tst assert_extension.py: using RAC 181 15:55:13.811178 tst assert_extension.py: using CellId 22111 15:55:13.929724 tst assert_extension.py: using BVCI 22112 15:55:14.049050 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 15:55:14.167031 tst assert_extension.py:10: start nitb and bts... 15:55:14.369661 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:55:14.982219 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19683): Launched 15:55:15.283735 run osmo-nitb_10.42.42.2(pid=19684): Launched 15:55:15.450059 run osmo-nitb_10.42.42.2(pid=19684): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19684)] 15:55:15.584662 run osmo-nitb_10.42.42.2(pid=19684): stdout: | (launched: 2022-12-09_15:55:15.228740) 15:55:15.720795 run osmo-nitb_10.42.42.2(pid=19684): stderr: | (launched: 2022-12-09_15:55:15.273430) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:55:15.863796 run osmo-nitb_10.42.42.2(pid=19684): stdout: | (launched: 2022-12-09_15:55:15.228740) 15:55:16.005215 run osmo-nitb_10.42.42.2(pid=19684): stderr: | (launched: 2022-12-09_15:55:15.273430) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19684): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19684) [trial-2361↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19684)] 15:55:16.397900 tst osmo-nitb_10.42.42.2(pid=19684): stdout: | (launched: 2022-12-09_15:55:15.228740) 15:55:16.524248 tst osmo-nitb_10.42.42.2(pid=19684): stderr: | (launched: 2022-12-09_15:55:15.273430) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:55:16.671032 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=19684): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19684) [trial-2361↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19684)] [trial-2361↪nitb_ussd:trx-b200↪assert_extension.py:12] 15:55:16.680242 tst assert_extension.py:12: Test FAILED (3.2 sec) 15:55:16.687504 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19683): Terminating (SIGTERM) 15:55:16.898722 --- ParallelTerminationStrategy: PID 19683 died... 15:55:16.918552 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19683): Terminated: ok {rc=0} 15:55:17.015466 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 ussd:trx-b200 --------------------------------------------------------------------- 15:55:18.205190 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:55:18.209600 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 15:55:18.246178 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 15:55:18.274676 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 15:55:18.310804 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 15:55:18.346375 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 15:55:18.374158 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 15:55:18.899179 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2361 ussd:trx-b200 assert_extension.py ---------------------------------------------- 15:55:18.905086 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:18.916131 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 15:55:18.963305 tst assert_extension.py: using LAC 22112 15:55:19.080433 tst assert_extension.py: using RAC 182 15:55:19.202144 tst assert_extension.py: using CellId 22112 15:55:19.318499 tst assert_extension.py: using BVCI 22113 15:55:19.426911 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:19.437507 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:19.447933 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:19.458436 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:19.468788 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:55:19.479272 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 15:55:19.597410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:55:20.095076 run create_hlr_db(pid=19688): Launched 15:55:20.218645 bus /sierra_2: Setting Powered False 15:55:21.282175 run create_hlr_db(pid=19688): Terminated: ok {rc=0} 15:55:21.714350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19690): Launched 15:55:22.018364 run osmo-hlr_10.42.42.2(pid=19691): Launched 15:55:22.132345 run osmo-stp_10.42.42.5: Starting osmo-stp 15:55:22.649742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19693): Launched 15:55:22.950292 run osmo-stp_10.42.42.5(pid=19694): Launched 15:55:23.064303 run osmo-msc_10.42.42.6: Starting osmo-msc 15:55:23.603947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19696): Launched 15:55:23.905134 run osmo-msc_10.42.42.6(pid=19697): Launched 15:55:24.073733 run osmo-stp_10.42.42.5(pid=19694): ERR: Terminated: ERROR {rc=1} [trial-2361↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19694)] 15:55:24.200753 run osmo-stp_10.42.42.5(pid=19694): stdout: | (launched: 2022-12-09_15:55:22.894972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:24.327308 run osmo-stp_10.42.42.5(pid=19694): stderr: | [0;m[38;5;43m20221209155523062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155523062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155523062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155523063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155523063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155523063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155523063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:24.452239 run osmo-stp_10.42.42.5(pid=19694): stdout: | (launched: 2022-12-09_15:55:22.894972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:24.572264 run osmo-stp_10.42.42.5(pid=19694): stderr: | [0;m[38;5;43m20221209155523062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155523062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155523062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155523063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155523063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155523063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155523063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:24.716203 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=19694): Process ended prematurely: osmo-stp_10.42.42.5(pid=19694) [trial-2361↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19694)] [trial-2361↪ussd:trx-b200↪assert_extension.py:17] 15:55:24.724581 tst assert_extension.py:17: Test FAILED (5.8 sec) 15:55:24.750989 run osmo-hlr_10.42.42.2(pid=19691): ERR: Terminated: ERROR {rc=237} [trial-2361↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19691)] 15:55:24.799953 run osmo-hlr_10.42.42.2(pid=19691): stdout: | (launched: 2022-12-09_15:55:21.962399) 15:55:24.850392 run osmo-hlr_10.42.42.2(pid=19691): stderr: | [0;m[1;31m20221209155522137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155522137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155522137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155522137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155522137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155522137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155522151 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155522161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155522161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155522161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:55:24.919940 run osmo-msc_10.42.42.6(pid=19697): ERR: Terminated: ERROR {rc=2} [trial-2361↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19697)] 15:55:24.967865 run osmo-msc_10.42.42.6(pid=19697): stdout: | (launched: 2022-12-09_15:55:23.849728) 15:55:25.017547 run osmo-msc_10.42.42.6(pid=19697): stderr: | [0;m[38;5;43m20221209155524121 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155524121 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f547d4dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155524122 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155524122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155524123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155524123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155524125 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155524125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155524125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155524125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:55:25.067827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19690): Terminating (SIGTERM) 15:55:25.108397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19693): Terminating (SIGTERM) 15:55:25.148548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19696): Terminating (SIGTERM) 15:55:25.189108 --- ParallelTerminationStrategy: PID 19690 died... 15:55:25.208454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19690): Terminated: ok {rc=0} 15:55:25.253233 --- ParallelTerminationStrategy: PID 19693 died... 15:55:25.272108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19693): Terminated: ok {rc=0} 15:55:25.316633 --- ParallelTerminationStrategy: PID 19696 died... 15:55:25.335553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19696): Terminated: ok {rc=0} 15:55:25.419982 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 15:55:26.631149 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:55:26.637568 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 15:55:26.670583 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 15:55:26.697404 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 15:55:26.748466 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 15:55:26.781278 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 15:55:26.807610 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 15:55:27.359526 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 15:55:27.408853 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:27.420119 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:55:27.489631 tst mo_mt_call.py: using LAC 22113 15:55:27.609104 tst mo_mt_call.py: using RAC 183 15:55:27.727965 tst mo_mt_call.py: using CellId 22113 15:55:27.848412 tst mo_mt_call.py: using BVCI 22114 15:55:27.959686 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:27.970785 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:27.981643 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:27.992549 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:28.003545 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:28.014393 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:55:28.130600 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:55:28.246324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:55:28.721118 run create_hlr_db(pid=19702): Launched 15:55:28.846340 bus /sierra_2: Setting Powered False 15:55:29.910776 run create_hlr_db(pid=19702): Terminated: ok {rc=0} 15:55:30.365353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19704): Launched 15:55:30.691700 run osmo-hlr_10.42.42.2(pid=19705): Launched 15:55:30.817000 run osmo-stp_10.42.42.5: Starting osmo-stp 15:55:31.487020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19707): Launched 15:55:31.824482 run osmo-stp_10.42.42.5(pid=19708): Launched 15:55:32.118724 run osmo-msc_10.42.42.6: Starting osmo-msc 15:55:32.711644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19710): Launched 15:55:33.020622 run osmo-msc_10.42.42.6(pid=19711): Launched 15:55:33.192097 run osmo-stp_10.42.42.5(pid=19708): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19708)] 15:55:33.320256 run osmo-stp_10.42.42.5(pid=19708): stdout: | (launched: 2022-12-09_15:55:31.759507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:33.448655 run osmo-stp_10.42.42.5(pid=19708): stderr: | [0;m[38;5;43m20221209155531975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155531975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155531976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155531976 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155531977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155531977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155531977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:33.576274 run osmo-stp_10.42.42.5(pid=19708): stdout: | (launched: 2022-12-09_15:55:31.759507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:33.697847 run osmo-stp_10.42.42.5(pid=19708): stderr: | [0;m[38;5;43m20221209155531975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155531975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155531976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155531976 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155531977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155531977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155531977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:33.843566 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19708): Process ended prematurely: osmo-stp_10.42.42.5(pid=19708) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19708)] [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 15:55:33.852778 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 15:55:33.879215 run osmo-hlr_10.42.42.2(pid=19705): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19705)] 15:55:33.927146 run osmo-hlr_10.42.42.2(pid=19705): stdout: | (launched: 2022-12-09_15:55:30.632519) 15:55:33.976927 run osmo-hlr_10.42.42.2(pid=19705): stderr: | [0;m[1;31m20221209155530845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155530845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155530845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155530845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155530845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155530845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155530871 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155530884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155530884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155530884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:55:34.046214 run osmo-msc_10.42.42.6(pid=19711): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19711)] 15:55:34.094369 run osmo-msc_10.42.42.6(pid=19711): stdout: | (launched: 2022-12-09_15:55:32.964396) 15:55:34.143934 run osmo-msc_10.42.42.6(pid=19711): stderr: | [0;m[38;5;43m20221209155533239 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155533239 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f925be3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155533239 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155533239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155533240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155533240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155533242 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155533242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155533242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155533242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:55:34.193571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19704): Terminating (SIGTERM) 15:55:34.233198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19707): Terminating (SIGTERM) 15:55:34.272929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19710): Terminating (SIGTERM) 15:55:34.312936 --- ParallelTerminationStrategy: PID 19704 died... 15:55:34.332009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19704): Terminated: ok {rc=0} 15:55:34.376255 --- ParallelTerminationStrategy: PID 19707 died... 15:55:34.394762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19707): Terminated: ok {rc=0} 15:55:34.438819 --- ParallelTerminationStrategy: PID 19710 died... 15:55:34.457421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19710): Terminated: ok {rc=0} 15:55:34.543723 bus /sierra_3: Setting Powered False 15:55:35.644667 bus /sierra_3: Setting Powered False 15:55:36.760561 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 15:55:37.908485 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:37.920593 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:55:37.990415 tst mo_mt_call_osmux.py: using LAC 22114 15:55:38.110269 tst mo_mt_call_osmux.py: using RAC 184 15:55:38.231698 tst mo_mt_call_osmux.py: using CellId 22114 15:55:38.352835 tst mo_mt_call_osmux.py: using BVCI 22115 15:55:38.462935 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:38.474114 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:38.485011 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:38.495878 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:38.506956 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:55:38.517879 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:55:38.633840 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:55:38.757602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:55:39.232258 run create_hlr_db(pid=19713): Launched 15:55:39.357510 bus /sierra_2: Setting Powered False 15:55:40.418052 run create_hlr_db(pid=19713): Terminated: ok {rc=0} 15:55:40.864859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19715): Launched 15:55:41.192284 run osmo-hlr_10.42.42.2(pid=19716): Launched 15:55:41.317133 run osmo-stp_10.42.42.5: Starting osmo-stp 15:55:41.884129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19718): Launched 15:55:42.219160 run osmo-stp_10.42.42.5(pid=19719): Launched 15:55:42.335374 run osmo-msc_10.42.42.6: Starting osmo-msc 15:55:42.887472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19721): Launched 15:55:43.193540 run osmo-msc_10.42.42.6(pid=19722): Launched 15:55:43.364372 run osmo-stp_10.42.42.5(pid=19719): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19719)] 15:55:43.493183 run osmo-stp_10.42.42.5(pid=19719): stdout: | (launched: 2022-12-09_15:55:42.162833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:43.621676 run osmo-stp_10.42.42.5(pid=19719): stderr: | [0;m[38;5;43m20221209155542334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155542334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155542334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155542335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155542335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155542335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155542335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:43.748132 run osmo-stp_10.42.42.5(pid=19719): stdout: | (launched: 2022-12-09_15:55:42.162833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:43.868292 run osmo-stp_10.42.42.5(pid=19719): stderr: | [0;m[38;5;43m20221209155542334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155542334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155542334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155542335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155542335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155542335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155542335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:44.012498 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19719): Process ended prematurely: osmo-stp_10.42.42.5(pid=19719) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19719)] [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 15:55:44.021606 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:55:44.047884 run osmo-hlr_10.42.42.2(pid=19716): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19716)] 15:55:44.095509 run osmo-hlr_10.42.42.2(pid=19716): stdout: | (launched: 2022-12-09_15:55:41.132545) 15:55:44.145078 run osmo-hlr_10.42.42.2(pid=19716): stderr: | [0;m[1;31m20221209155541329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155541329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155541329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155541329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155541329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155541329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155541342 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155541350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155541351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155541351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:55:44.214745 run osmo-msc_10.42.42.6(pid=19722): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19722)] 15:55:44.262181 run osmo-msc_10.42.42.6(pid=19722): stdout: | (launched: 2022-12-09_15:55:43.137617) 15:55:44.311351 run osmo-msc_10.42.42.6(pid=19722): stderr: | [0;m[38;5;43m20221209155543409 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155543409 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faa14d35c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155543409 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155543409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155543409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155543410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155543411 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155543412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155543412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155543412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:55:44.360844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19715): Terminating (SIGTERM) 15:55:44.400383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19718): Terminating (SIGTERM) 15:55:44.439920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19721): Terminating (SIGTERM) 15:55:44.479958 --- ParallelTerminationStrategy: PID 19715 died... 15:55:44.499218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19715): Terminated: ok {rc=0} 15:55:44.543332 --- ParallelTerminationStrategy: PID 19718 died... 15:55:44.561760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19718): Terminated: ok {rc=0} 15:55:44.606250 --- ParallelTerminationStrategy: PID 19721 died... 15:55:44.624982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19721): Terminated: ok {rc=0} 15:55:44.711905 bus /sierra_3: Setting Powered False 15:55:45.811549 bus /sierra_3: Setting Powered False 15:55:46.930162 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 15:55:48.179148 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:55:48.185717 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 15:55:48.220534 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 15:55:48.247491 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 15:55:48.301099 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 15:55:48.334889 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 15:55:48.361763 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 15:55:48.911310 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 15:55:48.960048 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:55:48.971371 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:55:49.040677 tst mo_mt_call.py: using LAC 22115 15:55:49.160269 tst mo_mt_call.py: using RAC 185 15:55:49.280397 tst mo_mt_call.py: using CellId 22115 15:55:49.403735 tst mo_mt_call.py: using BVCI 22116 15:55:49.515283 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:55:49.526568 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:55:49.537611 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:55:49.548510 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:55:49.559593 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:55:49.570539 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:55:49.688827 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:55:49.806256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:55:50.279665 run create_hlr_db(pid=19727): Launched 15:55:50.404635 bus /sierra_2: Setting Powered False 15:55:51.464572 run create_hlr_db(pid=19727): Terminated: ok {rc=0} 15:55:51.912752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19729): Launched 15:55:52.242058 run osmo-hlr_10.42.42.2(pid=19730): Launched 15:55:52.367809 run osmo-stp_10.42.42.5: Starting osmo-stp 15:55:52.933056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19732): Launched 15:55:53.260875 run osmo-stp_10.42.42.5(pid=19733): Launched 15:55:53.387478 run osmo-msc_10.42.42.6: Starting osmo-msc 15:55:53.979447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19741): Launched 15:55:54.309297 run osmo-msc_10.42.42.6(pid=19742): Launched 15:55:54.490819 run osmo-stp_10.42.42.5(pid=19733): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19733)] 15:55:54.628603 run osmo-stp_10.42.42.5(pid=19733): stdout: | (launched: 2022-12-09_15:55:53.201527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:54.767905 run osmo-stp_10.42.42.5(pid=19733): stderr: | [0;m[38;5;43m20221209155553391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155553391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155553391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155553392 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155553392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155553392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155553392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:54.904738 run osmo-stp_10.42.42.5(pid=19733): stdout: | (launched: 2022-12-09_15:55:53.201527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:55:55.034697 run osmo-stp_10.42.42.5(pid=19733): stderr: | [0;m[38;5;43m20221209155553391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155553391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155553391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155553392 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155553392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155553392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155553392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:55:55.190399 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19733): Process ended prematurely: osmo-stp_10.42.42.5(pid=19733) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19733)] [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 15:55:55.199886 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 15:55:55.228275 run osmo-hlr_10.42.42.2(pid=19730): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19730)] 15:55:55.279057 run osmo-hlr_10.42.42.2(pid=19730): stdout: | (launched: 2022-12-09_15:55:52.182233) 15:55:55.331487 run osmo-hlr_10.42.42.2(pid=19730): stderr: | [0;m[1;31m20221209155552379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155552379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155552379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155552379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155552379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155552379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155552391 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155552400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155552400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155552400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:55:55.404205 run osmo-msc_10.42.42.6(pid=19742): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19742)] 15:55:55.454674 run osmo-msc_10.42.42.6(pid=19742): stdout: | (launched: 2022-12-09_15:55:54.248544) 15:55:55.507283 run osmo-msc_10.42.42.6(pid=19742): stderr: | [0;m[38;5;43m20221209155554572 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155554572 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efef5462c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155554572 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155554572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155554572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155554572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155554574 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155554575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155554575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155554575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:55:55.560165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19729): Terminating (SIGTERM) 15:55:55.602858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19732): Terminating (SIGTERM) 15:55:55.645472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19741): Terminating (SIGTERM) 15:55:55.688221 --- ParallelTerminationStrategy: PID 19729 died... 15:55:55.708477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19729): Terminated: ok {rc=0} 15:55:55.755979 --- ParallelTerminationStrategy: PID 19732 died... 15:55:55.775827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19732): Terminated: ok {rc=0} 15:55:55.822993 --- ParallelTerminationStrategy: PID 19741 died... 15:55:55.842758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19741): Terminated: ok {rc=0} 15:55:55.931739 bus /sierra_3: Setting Powered False 15:55:57.032635 bus /sierra_3: Setting Powered False 15:55:58.149309 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 15:55:59.299410 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:55:59.311960 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:55:59.397793 tst mo_mt_call_osmux.py: using LAC 22116 15:55:59.522056 tst mo_mt_call_osmux.py: using RAC 186 15:55:59.641869 tst mo_mt_call_osmux.py: using CellId 22116 15:55:59.760602 tst mo_mt_call_osmux.py: using BVCI 22117 15:55:59.870857 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:55:59.882078 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:55:59.893410 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:55:59.904539 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:55:59.915632 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:55:59.926592 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:56:00.049095 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:56:00.173709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:00.680711 run create_hlr_db(pid=19744): Launched 15:56:00.806419 bus /sierra_2: Setting Powered False 15:56:01.885498 run create_hlr_db(pid=19744): Terminated: ok {rc=0} 15:56:02.382936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19746): Launched 15:56:02.714628 run osmo-hlr_10.42.42.2(pid=19747): Launched 15:56:02.842815 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:03.415899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19749): Launched 15:56:03.743134 run osmo-stp_10.42.42.5(pid=19750): Launched 15:56:03.869357 run osmo-msc_10.42.42.6: Starting osmo-msc 15:56:04.467850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19752): Launched 15:56:04.797753 run osmo-msc_10.42.42.6(pid=19753): Launched 15:56:04.980329 run osmo-stp_10.42.42.5(pid=19750): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19750)] 15:56:05.118804 run osmo-stp_10.42.42.5(pid=19750): stdout: | (launched: 2022-12-09_15:56:03.683610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:05.258463 run osmo-stp_10.42.42.5(pid=19750): stderr: | [0;m[38;5;43m20221209155603877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155603877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155603877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155603877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155603878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155603878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155603878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:05.395801 run osmo-stp_10.42.42.5(pid=19750): stdout: | (launched: 2022-12-09_15:56:03.683610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:05.526567 run osmo-stp_10.42.42.5(pid=19750): stderr: | [0;m[38;5;43m20221209155603877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155603877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155603877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155603877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155603878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155603878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155603878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:05.683088 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19750): Process ended prematurely: osmo-stp_10.42.42.5(pid=19750) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19750)] [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 15:56:05.693097 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 15:56:05.721823 run osmo-hlr_10.42.42.2(pid=19747): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19747)] 15:56:05.772784 run osmo-hlr_10.42.42.2(pid=19747): stdout: | (launched: 2022-12-09_15:56:02.654989) 15:56:05.825571 run osmo-hlr_10.42.42.2(pid=19747): stderr: | [0;m[1;31m20221209155602851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155602851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155602851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155602852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155602852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155602852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155602863 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155602872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155602872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155602872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:56:05.898735 run osmo-msc_10.42.42.6(pid=19753): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19753)] 15:56:05.949418 run osmo-msc_10.42.42.6(pid=19753): stdout: | (launched: 2022-12-09_15:56:04.737485) 15:56:06.001756 run osmo-msc_10.42.42.6(pid=19753): stderr: | [0;m[38;5;43m20221209155605060 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155605060 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff06e289c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155605060 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155605061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155605061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155605061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155605063 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155605063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155605063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155605063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:56:06.054697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19746): Terminating (SIGTERM) 15:56:06.097207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19749): Terminating (SIGTERM) 15:56:06.139669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19752): Terminating (SIGTERM) 15:56:06.182133 --- ParallelTerminationStrategy: PID 19746 died... 15:56:06.202210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19746): Terminated: ok {rc=0} 15:56:06.248804 --- ParallelTerminationStrategy: PID 19749 died... 15:56:06.268721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19749): Terminated: ok {rc=0} 15:56:06.315349 --- ParallelTerminationStrategy: PID 19752 died... 15:56:06.334935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19752): Terminated: ok {rc=0} 15:56:06.423750 bus /sierra_3: Setting Powered False 15:56:07.523482 bus /sierra_3: Setting Powered False 15:56:08.640807 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 15:56:09.897986 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:56:09.905384 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 15:56:09.938940 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 15:56:09.965739 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 15:56:10.017588 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 15:56:10.050305 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 15:56:10.076794 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 15:56:10.631274 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 15:56:10.680358 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:10.691759 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:56:10.760174 tst mo_mt_call.py: using LAC 22117 15:56:10.878842 tst mo_mt_call.py: using RAC 187 15:56:10.998330 tst mo_mt_call.py: using CellId 22117 15:56:11.117329 tst mo_mt_call.py: using BVCI 22118 15:56:11.227209 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:11.238485 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:11.249537 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:11.260517 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:11.271605 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:11.282686 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:56:11.402655 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:56:11.522015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:11.995473 run create_hlr_db(pid=19758): Launched 15:56:12.121810 bus /sierra_2: Setting Powered False 15:56:13.182471 run create_hlr_db(pid=19758): Terminated: ok {rc=0} 15:56:13.630005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19760): Launched 15:56:13.960589 run osmo-hlr_10.42.42.2(pid=19761): Launched 15:56:14.088310 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:14.651211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19763): Launched 15:56:14.980008 run osmo-stp_10.42.42.5(pid=19764): Launched 15:56:15.105301 run osmo-msc_10.42.42.6: Starting osmo-msc 15:56:15.698431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19766): Launched 15:56:16.072162 run osmo-msc_10.42.42.6(pid=19767): Launched 15:56:16.383535 run osmo-stp_10.42.42.5(pid=19764): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19764)] 15:56:16.689195 run osmo-stp_10.42.42.5(pid=19764): stdout: | (launched: 2022-12-09_15:56:14.920335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:16.982712 run osmo-stp_10.42.42.5(pid=19764): stderr: | [0;m[38;5;43m20221209155615112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155615112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155615112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155615113 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155615113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155615114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155615114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:17.123742 run osmo-stp_10.42.42.5(pid=19764): stdout: | (launched: 2022-12-09_15:56:14.920335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:17.258361 run osmo-stp_10.42.42.5(pid=19764): stderr: | [0;m[38;5;43m20221209155615112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155615112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155615112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155615113 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155615113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155615114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155615114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:17.415518 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19764): Process ended prematurely: osmo-stp_10.42.42.5(pid=19764) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19764)] [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 15:56:17.425283 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 15:56:17.453954 run osmo-hlr_10.42.42.2(pid=19761): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19761)] 15:56:17.504805 run osmo-hlr_10.42.42.2(pid=19761): stdout: | (launched: 2022-12-09_15:56:13.901472) 15:56:17.557287 run osmo-hlr_10.42.42.2(pid=19761): stderr: | [0;m[1;31m20221209155614097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155614097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155614097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155614097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155614097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155614097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155614110 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155614119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155614119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155614119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:56:17.630024 run osmo-msc_10.42.42.6(pid=19767): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19767)] 15:56:17.680464 run osmo-msc_10.42.42.6(pid=19767): stdout: | (launched: 2022-12-09_15:56:16.009898) 15:56:17.732450 run osmo-msc_10.42.42.6(pid=19767): stderr: | [0;m[38;5;43m20221209155616717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155616717 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f595e9adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155616717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155616717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155616717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155616718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155616719 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155616720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155616720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155616720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:56:17.785405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19760): Terminating (SIGTERM) 15:56:17.827788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19763): Terminating (SIGTERM) 15:56:17.870038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19766): Terminating (SIGTERM) 15:56:17.912536 --- ParallelTerminationStrategy: PID 19760 died... 15:56:17.932668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19760): Terminated: ok {rc=0} 15:56:17.979551 --- ParallelTerminationStrategy: PID 19763 died... 15:56:17.999343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19763): Terminated: ok {rc=0} 15:56:18.046152 --- ParallelTerminationStrategy: PID 19766 died... 15:56:18.066200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19766): Terminated: ok {rc=0} 15:56:18.155657 bus /sierra_3: Setting Powered False 15:56:19.255949 bus /sierra_3: Setting Powered False 15:56:20.374170 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 15:56:21.524857 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:21.537640 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:56:21.610596 tst mo_mt_call_osmux.py: using LAC 22118 15:56:21.743752 tst mo_mt_call_osmux.py: using RAC 188 15:56:21.864879 tst mo_mt_call_osmux.py: using CellId 22118 15:56:21.984004 tst mo_mt_call_osmux.py: using BVCI 22119 15:56:22.094559 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:22.105903 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:22.117221 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:22.128347 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:22.139750 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:56:22.150763 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:56:22.271356 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:56:22.390487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:22.869530 run create_hlr_db(pid=19769): Launched 15:56:22.995409 bus /sierra_2: Setting Powered False 15:56:24.056156 run create_hlr_db(pid=19769): Terminated: ok {rc=0} 15:56:24.503993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19771): Launched 15:56:24.832525 run osmo-hlr_10.42.42.2(pid=19772): Launched 15:56:24.959519 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:25.527982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19777): Launched 15:56:25.857043 run osmo-stp_10.42.42.5(pid=19778): Launched 15:56:25.982915 run osmo-msc_10.42.42.6: Starting osmo-msc 15:56:26.575967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19780): Launched 15:56:26.906150 run osmo-msc_10.42.42.6(pid=19781): Launched 15:56:27.090539 run osmo-stp_10.42.42.5(pid=19778): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19778)] 15:56:27.228594 run osmo-stp_10.42.42.5(pid=19778): stdout: | (launched: 2022-12-09_15:56:25.797649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:27.367604 run osmo-stp_10.42.42.5(pid=19778): stderr: | [0;m[38;5;43m20221209155625987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155625987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155625988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155625988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155625989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155625989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155625989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:27.504811 run osmo-stp_10.42.42.5(pid=19778): stdout: | (launched: 2022-12-09_15:56:25.797649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:27.635096 run osmo-stp_10.42.42.5(pid=19778): stderr: | [0;m[38;5;43m20221209155625987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155625987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155625988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155625988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155625989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155625989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155625989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:27.791538 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19778): Process ended prematurely: osmo-stp_10.42.42.5(pid=19778) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19778)] [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 15:56:27.801222 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:56:27.829892 run osmo-hlr_10.42.42.2(pid=19772): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19772)] 15:56:27.880525 run osmo-hlr_10.42.42.2(pid=19772): stdout: | (launched: 2022-12-09_15:56:24.773321) 15:56:27.932922 run osmo-hlr_10.42.42.2(pid=19772): stderr: | [0;m[1;31m20221209155624970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155624970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155624970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155624970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155624970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155624970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155624983 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155624992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155624992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155624992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:56:28.005962 run osmo-msc_10.42.42.6(pid=19781): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19781)] 15:56:28.056646 run osmo-msc_10.42.42.6(pid=19781): stdout: | (launched: 2022-12-09_15:56:26.846302) 15:56:28.109231 run osmo-msc_10.42.42.6(pid=19781): stderr: | [0;m[38;5;43m20221209155627167 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155627167 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9d28e37c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155627167 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155627167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155627167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155627167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155627169 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155627170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155627170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155627170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:56:28.162076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19771): Terminating (SIGTERM) 15:56:28.204723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19777): Terminating (SIGTERM) 15:56:28.247525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19780): Terminating (SIGTERM) 15:56:28.290163 --- ParallelTerminationStrategy: PID 19771 died... 15:56:28.310233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19771): Terminated: ok {rc=0} 15:56:28.357282 --- ParallelTerminationStrategy: PID 19777 died... 15:56:28.376861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19777): Terminated: ok {rc=0} 15:56:28.423535 --- ParallelTerminationStrategy: PID 19780 died... 15:56:28.443177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19780): Terminated: ok {rc=0} 15:56:28.532141 bus /sierra_3: Setting Powered False 15:56:29.630641 bus /sierra_3: Setting Powered False 15:56:30.747265 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 15:56:32.000141 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:56:32.006726 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 15:56:32.041777 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 15:56:32.069978 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 15:56:32.121138 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 15:56:32.155076 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 15:56:32.184225 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 15:56:32.737073 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 15:56:32.790828 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:32.802815 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:56:32.873072 tst mo_mt_call.py: using LAC 22119 15:56:32.998739 tst mo_mt_call.py: using RAC 189 15:56:33.125255 tst mo_mt_call.py: using CellId 22119 15:56:33.253324 tst mo_mt_call.py: using BVCI 22120 15:56:33.371539 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:33.383176 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:33.394635 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:33.406229 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:33.418102 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:33.429801 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:56:33.550224 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:56:33.667382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:34.142661 run create_hlr_db(pid=19786): Launched 15:56:34.268882 bus /sierra_2: Setting Powered False 15:56:35.329966 run create_hlr_db(pid=19786): Terminated: ok {rc=0} 15:56:35.779108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19788): Launched 15:56:36.109328 run osmo-hlr_10.42.42.2(pid=19789): Launched 15:56:36.235918 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:36.799937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19791): Launched 15:56:37.129471 run osmo-stp_10.42.42.5(pid=19792): Launched 15:56:37.255202 run osmo-msc_10.42.42.6: Starting osmo-msc 15:56:37.850374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19794): Launched 15:56:38.161365 run osmo-msc_10.42.42.6(pid=19795): Launched 15:56:38.331692 run osmo-stp_10.42.42.5(pid=19792): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19792)] 15:56:38.460570 run osmo-stp_10.42.42.5(pid=19792): stdout: | (launched: 2022-12-09_15:56:37.069955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:38.591241 run osmo-stp_10.42.42.5(pid=19792): stderr: | [0;m[38;5;43m20221209155637260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155637260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155637260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155637261 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155637261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155637261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155637261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:38.719308 run osmo-stp_10.42.42.5(pid=19792): stdout: | (launched: 2022-12-09_15:56:37.069955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:38.841098 run osmo-stp_10.42.42.5(pid=19792): stderr: | [0;m[38;5;43m20221209155637260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155637260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155637260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155637261 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155637261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155637261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155637261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:38.986600 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19792): Process ended prematurely: osmo-stp_10.42.42.5(pid=19792) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19792)] [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 15:56:38.995495 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:56:39.021959 run osmo-hlr_10.42.42.2(pid=19789): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19789)] 15:56:39.069803 run osmo-hlr_10.42.42.2(pid=19789): stdout: | (launched: 2022-12-09_15:56:36.049555) 15:56:39.119178 run osmo-hlr_10.42.42.2(pid=19789): stderr: | [0;m[1;31m20221209155636248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155636248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155636248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155636248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155636248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155636248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155636261 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155636270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155636270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155636270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:56:39.188586 run osmo-msc_10.42.42.6(pid=19795): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19795)] 15:56:39.236384 run osmo-msc_10.42.42.6(pid=19795): stdout: | (launched: 2022-12-09_15:56:38.104077) 15:56:39.286307 run osmo-msc_10.42.42.6(pid=19795): stderr: | [0;m[38;5;43m20221209155638377 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155638377 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f68f0f68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155638378 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155638378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155638378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155638378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155638380 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155638380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155638380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155638380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:56:39.336042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19788): Terminating (SIGTERM) 15:56:39.375788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19791): Terminating (SIGTERM) 15:56:39.415460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19794): Terminating (SIGTERM) 15:56:39.455370 --- ParallelTerminationStrategy: PID 19788 died... 15:56:39.474614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19788): Terminated: ok {rc=0} 15:56:39.518849 --- ParallelTerminationStrategy: PID 19791 died... 15:56:39.537640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19791): Terminated: ok {rc=0} 15:56:39.581564 --- ParallelTerminationStrategy: PID 19794 died... 15:56:39.600551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19794): Terminated: ok {rc=0} 15:56:39.684580 bus /sierra_3: Setting Powered False 15:56:40.783629 bus /sierra_3: Setting Powered False 15:56:41.904126 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 15:56:43.050963 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:43.063068 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:56:43.133664 tst mo_mt_call_osmux.py: using LAC 22120 15:56:43.255586 tst mo_mt_call_osmux.py: using RAC 190 15:56:43.375492 tst mo_mt_call_osmux.py: using CellId 22120 15:56:43.504718 tst mo_mt_call_osmux.py: using BVCI 22121 15:56:43.623180 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:43.634962 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:43.646706 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:43.658455 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:43.670409 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:56:43.682436 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:56:43.801306 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:56:43.919737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:44.394480 run create_hlr_db(pid=19797): Launched 15:56:44.519504 bus /sierra_2: Setting Powered False 15:56:45.580028 run create_hlr_db(pid=19797): Terminated: ok {rc=0} 15:56:46.080688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19799): Launched 15:56:46.416490 run osmo-hlr_10.42.42.2(pid=19800): Launched 15:56:46.616311 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:47.276924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19802): Launched 15:56:47.605601 run osmo-stp_10.42.42.5(pid=19803): Launched 15:56:47.730252 run osmo-msc_10.42.42.6: Starting osmo-msc 15:56:48.321792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19805): Launched 15:56:48.651442 run osmo-msc_10.42.42.6(pid=19806): Launched 15:56:48.834902 run osmo-stp_10.42.42.5(pid=19803): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19803)] 15:56:48.973173 run osmo-stp_10.42.42.5(pid=19803): stdout: | (launched: 2022-12-09_15:56:47.545930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:49.111755 run osmo-stp_10.42.42.5(pid=19803): stderr: | [0;m[38;5;43m20221209155647738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155647738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155647738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155647739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155647739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155647739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155647739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:49.249023 run osmo-stp_10.42.42.5(pid=19803): stdout: | (launched: 2022-12-09_15:56:47.545930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:56:49.379122 run osmo-stp_10.42.42.5(pid=19803): stderr: | [0;m[38;5;43m20221209155647738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155647738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155647738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155647739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155647739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155647739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155647739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:56:49.534936 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19803): Process ended prematurely: osmo-stp_10.42.42.5(pid=19803) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19803)] [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 15:56:49.544381 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 15:56:49.572326 run osmo-hlr_10.42.42.2(pid=19800): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19800)] 15:56:49.623124 run osmo-hlr_10.42.42.2(pid=19800): stdout: | (launched: 2022-12-09_15:56:46.354631) 15:56:49.675177 run osmo-hlr_10.42.42.2(pid=19800): stderr: | [0;m[1;31m20221209155646592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155646592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155646592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155646592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155646592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155646592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155646614 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155646635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155646635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155646635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:56:49.747862 run osmo-msc_10.42.42.6(pid=19806): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19806)] 15:56:49.798362 run osmo-msc_10.42.42.6(pid=19806): stdout: | (launched: 2022-12-09_15:56:48.591419) 15:56:49.850467 run osmo-msc_10.42.42.6(pid=19806): stderr: | [0;m[38;5;43m20221209155648913 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155648913 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f693b305c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155648913 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155648914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155648914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155648914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155648915 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155648916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155648916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155648916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:56:49.902886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19799): Terminating (SIGTERM) 15:56:49.944756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19802): Terminating (SIGTERM) 15:56:49.987150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19805): Terminating (SIGTERM) 15:56:50.029421 --- ParallelTerminationStrategy: PID 19799 died... 15:56:50.049340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19799): Terminated: ok {rc=0} 15:56:50.096139 --- ParallelTerminationStrategy: PID 19802 died... 15:56:50.115645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19802): Terminated: ok {rc=0} 15:56:50.161850 --- ParallelTerminationStrategy: PID 19805 died... 15:56:50.181337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19805): Terminated: ok {rc=0} 15:56:50.270213 bus /sierra_3: Setting Powered False 15:56:51.368534 bus /sierra_3: Setting Powered False 15:56:52.484286 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 15:56:53.735316 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:56:53.741765 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 15:56:53.774824 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 15:56:53.801741 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 15:56:53.854276 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 15:56:53.887562 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 15:56:53.914114 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 15:56:54.464279 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 15:56:54.513218 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:56:54.524313 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:56:54.593978 tst mo_mt_call.py: using LAC 22121 15:56:54.713687 tst mo_mt_call.py: using RAC 191 15:56:54.844397 tst mo_mt_call.py: using CellId 22121 15:56:54.970914 tst mo_mt_call.py: using BVCI 22122 15:56:55.090037 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:56:55.101802 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:56:55.113457 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:56:55.125530 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:56:55.137269 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:56:55.148813 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:56:55.265974 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:56:55.386468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:56:55.894281 run create_hlr_db(pid=19811): Launched 15:56:56.020115 bus /sierra_2: Setting Powered False 15:56:57.085321 run create_hlr_db(pid=19811): Terminated: ok {rc=0} 15:56:57.524697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19813): Launched 15:56:57.833063 run osmo-hlr_10.42.42.2(pid=19814): Launched 15:56:57.950612 run osmo-stp_10.42.42.5: Starting osmo-stp 15:56:58.481703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19816): Launched 15:56:58.788788 run osmo-stp_10.42.42.5(pid=19817): Launched 15:56:58.905487 run osmo-msc_10.42.42.6: Starting osmo-msc 15:56:59.458180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19819): Launched 15:56:59.768369 run osmo-msc_10.42.42.6(pid=19820): Launched 15:56:59.940453 run osmo-stp_10.42.42.5(pid=19817): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19817)] 15:57:00.069490 run osmo-stp_10.42.42.5(pid=19817): stdout: | (launched: 2022-12-09_15:56:58.732006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:00.201201 run osmo-stp_10.42.42.5(pid=19817): stderr: | [0;m[38;5;43m20221209155658903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155658903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155658903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155658904 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155658904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155658904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155658904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:00.328676 run osmo-stp_10.42.42.5(pid=19817): stdout: | (launched: 2022-12-09_15:56:58.732006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:00.450764 run osmo-stp_10.42.42.5(pid=19817): stderr: | [0;m[38;5;43m20221209155658903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155658903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155658903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155658904 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155658904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155658904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155658904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:00.596486 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19817): Process ended prematurely: osmo-stp_10.42.42.5(pid=19817) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19817)] [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 15:57:00.605423 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 15:57:00.631470 run osmo-hlr_10.42.42.2(pid=19814): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19814)] 15:57:00.679255 run osmo-hlr_10.42.42.2(pid=19814): stdout: | (launched: 2022-12-09_15:56:57.776500) 15:57:00.728780 run osmo-hlr_10.42.42.2(pid=19814): stderr: | [0;m[1;31m20221209155657957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155657957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155657957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155657957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155657957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155657957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155657970 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155657979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155657979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155657979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:00.798208 run osmo-msc_10.42.42.6(pid=19820): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19820)] 15:57:00.846960 run osmo-msc_10.42.42.6(pid=19820): stdout: | (launched: 2022-12-09_15:56:59.711818) 15:57:00.904244 run osmo-msc_10.42.42.6(pid=19820): stderr: | [0;m[38;5;43m20221209155659985 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155659985 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa2a1829c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155659985 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155659985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155659985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155659986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155659987 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155659988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155659988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155659988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:00.965128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19813): Terminating (SIGTERM) 15:57:01.005926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19816): Terminating (SIGTERM) 15:57:01.047290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19819): Terminating (SIGTERM) 15:57:01.088301 --- ParallelTerminationStrategy: PID 19813 died... 15:57:01.107797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19813): Terminated: ok {rc=0} 15:57:01.153718 --- ParallelTerminationStrategy: PID 19816 died... 15:57:01.173559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19816): Terminated: ok {rc=0} 15:57:01.219106 --- ParallelTerminationStrategy: PID 19819 died... 15:57:01.238337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19819): Terminated: ok {rc=0} 15:57:01.323921 bus /sierra_3: Setting Powered False 15:57:02.422443 bus /sierra_3: Setting Powered False 15:57:03.537969 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 15:57:04.689360 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:04.701987 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:57:04.774971 tst mo_mt_call_osmux.py: using LAC 22122 15:57:04.905742 tst mo_mt_call_osmux.py: using RAC 192 15:57:05.035607 tst mo_mt_call_osmux.py: using CellId 22122 15:57:05.163497 tst mo_mt_call_osmux.py: using BVCI 22123 15:57:05.282494 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:05.294111 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:05.305522 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:05.317260 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:05.329077 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:57:05.341034 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:57:05.462052 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:57:05.584511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:06.093217 run create_hlr_db(pid=19822): Launched 15:57:06.218989 bus /sierra_2: Setting Powered False 15:57:07.283680 run create_hlr_db(pid=19822): Terminated: ok {rc=0} 15:57:07.741719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19824): Launched 15:57:08.070302 run osmo-hlr_10.42.42.2(pid=19825): Launched 15:57:08.197808 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:08.761741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19827): Launched 15:57:09.091259 run osmo-stp_10.42.42.5(pid=19828): Launched 15:57:09.218980 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:09.813546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19830): Launched 15:57:10.141991 run osmo-msc_10.42.42.6(pid=19831): Launched 15:57:10.327003 run osmo-stp_10.42.42.5(pid=19828): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19828)] 15:57:10.469440 run osmo-stp_10.42.42.5(pid=19828): stdout: | (launched: 2022-12-09_15:57:09.031527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:10.607606 run osmo-stp_10.42.42.5(pid=19828): stderr: | [0;m[38;5;43m20221209155709221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155709221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155709221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155709221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155709222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155709222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155709222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:10.743933 run osmo-stp_10.42.42.5(pid=19828): stdout: | (launched: 2022-12-09_15:57:09.031527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:10.874885 run osmo-stp_10.42.42.5(pid=19828): stderr: | [0;m[38;5;43m20221209155709221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155709221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155709221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155709221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155709222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155709222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155709222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:11.030834 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19828): Process ended prematurely: osmo-stp_10.42.42.5(pid=19828) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19828)] [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 15:57:11.040652 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 15:57:11.069608 run osmo-hlr_10.42.42.2(pid=19825): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19825)] 15:57:11.120551 run osmo-hlr_10.42.42.2(pid=19825): stdout: | (launched: 2022-12-09_15:57:08.010892) 15:57:11.172932 run osmo-hlr_10.42.42.2(pid=19825): stderr: | [0;m[1;31m20221209155708207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155708207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155708207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155708207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155708207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155708207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155708219 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155708228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155708228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155708228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:11.246194 run osmo-msc_10.42.42.6(pid=19831): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19831)] 15:57:11.296756 run osmo-msc_10.42.42.6(pid=19831): stdout: | (launched: 2022-12-09_15:57:10.082151) 15:57:11.349373 run osmo-msc_10.42.42.6(pid=19831): stderr: | [0;m[38;5;43m20221209155710404 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155710404 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa0e6208c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155710404 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155710405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155710405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155710405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155710407 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155710407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155710407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155710407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:11.402056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19824): Terminating (SIGTERM) 15:57:11.444201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19827): Terminating (SIGTERM) 15:57:11.487023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19830): Terminating (SIGTERM) 15:57:11.529196 --- ParallelTerminationStrategy: PID 19824 died... 15:57:11.549300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19824): Terminated: ok {rc=0} 15:57:11.595822 --- ParallelTerminationStrategy: PID 19827 died... 15:57:11.615517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19827): Terminated: ok {rc=0} 15:57:11.661559 --- ParallelTerminationStrategy: PID 19830 died... 15:57:11.681138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19830): Terminated: ok {rc=0} 15:57:11.769500 bus /sierra_3: Setting Powered False 15:57:12.867946 bus /sierra_3: Setting Powered False 15:57:13.984669 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:57:15.236586 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:57:15.244125 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:57:15.278872 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 15:57:15.306858 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:57:15.360224 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:57:15.394592 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 15:57:15.422369 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:57:15.992735 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 15:57:16.044495 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:16.057529 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:57:16.127972 tst mo_mt_call.py: using LAC 22123 15:57:16.249594 tst mo_mt_call.py: using RAC 193 15:57:16.419126 tst mo_mt_call.py: using CellId 22123 15:57:16.576641 tst mo_mt_call.py: using BVCI 22124 15:57:16.728567 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:16.740726 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:16.752726 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:16.764556 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:16.776450 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:16.788178 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:57:16.908844 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:57:17.027689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:17.540415 run create_hlr_db(pid=19836): Launched 15:57:17.665390 bus /sierra_2: Setting Powered False 15:57:18.729295 run create_hlr_db(pid=19836): Terminated: ok {rc=0} 15:57:19.168583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19838): Launched 15:57:19.477684 run osmo-hlr_10.42.42.2(pid=19839): Launched 15:57:19.596330 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:20.123561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19841): Launched 15:57:20.430683 run osmo-stp_10.42.42.5(pid=19842): Launched 15:57:20.546892 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:21.107309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19844): Launched 15:57:21.415589 run osmo-msc_10.42.42.6(pid=19845): Launched 15:57:21.588141 run osmo-stp_10.42.42.5(pid=19842): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19842)] 15:57:21.717320 run osmo-stp_10.42.42.5(pid=19842): stdout: | (launched: 2022-12-09_15:57:20.374681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:21.846582 run osmo-stp_10.42.42.5(pid=19842): stderr: | [0;m[38;5;43m20221209155720543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155720543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155720544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155720544 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155720545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155720545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155720545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:21.973956 run osmo-stp_10.42.42.5(pid=19842): stdout: | (launched: 2022-12-09_15:57:20.374681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:22.095631 run osmo-stp_10.42.42.5(pid=19842): stderr: | [0;m[38;5;43m20221209155720543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155720543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155720544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155720544 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155720545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155720545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155720545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:22.241226 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19842): Process ended prematurely: osmo-stp_10.42.42.5(pid=19842) [trial-2361↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19842)] [trial-2361↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 15:57:22.249936 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:57:22.276124 run osmo-hlr_10.42.42.2(pid=19839): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19839)] 15:57:22.323611 run osmo-hlr_10.42.42.2(pid=19839): stdout: | (launched: 2022-12-09_15:57:19.421267) 15:57:22.372664 run osmo-hlr_10.42.42.2(pid=19839): stderr: | [0;m[1;31m20221209155719594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155719594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155719594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155719594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155719594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155719594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155719606 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155719614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155719614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155719614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:22.441287 run osmo-msc_10.42.42.6(pid=19845): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19845)] 15:57:22.488784 run osmo-msc_10.42.42.6(pid=19845): stdout: | (launched: 2022-12-09_15:57:21.358708) 15:57:22.537942 run osmo-msc_10.42.42.6(pid=19845): stderr: | [0;m[38;5;43m20221209155721630 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155721630 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fed7936ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155721630 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155721631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155721631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155721631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155721633 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155721633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155721633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155721633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:22.587574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19838): Terminating (SIGTERM) 15:57:22.627258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19841): Terminating (SIGTERM) 15:57:22.666911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19844): Terminating (SIGTERM) 15:57:22.706721 --- ParallelTerminationStrategy: PID 19838 died... 15:57:22.725737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19838): Terminated: ok {rc=0} 15:57:22.769551 --- ParallelTerminationStrategy: PID 19841 died... 15:57:22.787870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19841): Terminated: ok {rc=0} 15:57:22.831677 --- ParallelTerminationStrategy: PID 19844 died... 15:57:22.850184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19844): Terminated: ok {rc=0} 15:57:22.935926 bus /sierra_3: Setting Powered False 15:57:24.036242 bus /sierra_3: Setting Powered False 15:57:25.151260 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 15:57:26.303635 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:26.316325 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:57:26.389556 tst mo_mt_call_osmux.py: using LAC 22124 15:57:26.517042 tst mo_mt_call_osmux.py: using RAC 194 15:57:26.644915 tst mo_mt_call_osmux.py: using CellId 22124 15:57:26.774651 tst mo_mt_call_osmux.py: using BVCI 22125 15:57:26.895457 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:26.907299 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:26.919272 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:26.931208 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:26.943175 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:57:26.955281 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:57:27.074691 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:57:27.193802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:27.670859 run create_hlr_db(pid=19847): Launched 15:57:27.797147 bus /sierra_2: Setting Powered False 15:57:28.858234 run create_hlr_db(pid=19847): Terminated: ok {rc=0} 15:57:29.287841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19849): Launched 15:57:29.596509 run osmo-hlr_10.42.42.2(pid=19850): Launched 15:57:29.713952 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:30.246420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19852): Launched 15:57:30.555517 run osmo-stp_10.42.42.5(pid=19853): Launched 15:57:30.672627 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:31.277043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19855): Launched 15:57:31.621609 run osmo-msc_10.42.42.6(pid=19856): Launched 15:57:31.996498 run osmo-stp_10.42.42.5(pid=19853): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19853)] 15:57:32.190293 run osmo-stp_10.42.42.5(pid=19853): stdout: | (launched: 2022-12-09_15:57:30.499152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:32.333193 run osmo-stp_10.42.42.5(pid=19853): stderr: | [0;m[38;5;43m20221209155730669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155730669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155730669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155730670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155730670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155730670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155730670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:32.470411 run osmo-stp_10.42.42.5(pid=19853): stdout: | (launched: 2022-12-09_15:57:30.499152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:32.602287 run osmo-stp_10.42.42.5(pid=19853): stderr: | [0;m[38;5;43m20221209155730669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155730669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155730669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155730670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155730670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155730670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155730670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:32.759079 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19853): Process ended prematurely: osmo-stp_10.42.42.5(pid=19853) [trial-2361↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19853)] [trial-2361↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 15:57:32.769064 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 15:57:32.797667 run osmo-hlr_10.42.42.2(pid=19850): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19850)] 15:57:32.848297 run osmo-hlr_10.42.42.2(pid=19850): stdout: | (launched: 2022-12-09_15:57:29.540107) 15:57:32.900586 run osmo-hlr_10.42.42.2(pid=19850): stderr: | [0;m[1;31m20221209155729718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155729718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155729718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155729718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155729718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155729718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155729730 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155729741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155729741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155729741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:32.973450 run osmo-msc_10.42.42.6(pid=19856): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19856)] 15:57:33.023828 run osmo-msc_10.42.42.6(pid=19856): stdout: | (launched: 2022-12-09_15:57:31.561709) 15:57:33.076092 run osmo-msc_10.42.42.6(pid=19856): stderr: | [0;m[38;5;43m20221209155732069 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155732069 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe8ba7a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155732069 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155732069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155732070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155732070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155732072 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155732072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155732072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155732072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:33.128569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19849): Terminating (SIGTERM) 15:57:33.170365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19852): Terminating (SIGTERM) 15:57:33.212446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19855): Terminating (SIGTERM) 15:57:33.254761 --- ParallelTerminationStrategy: PID 19849 died... 15:57:33.274956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19849): Terminated: ok {rc=0} 15:57:33.321488 --- ParallelTerminationStrategy: PID 19852 died... 15:57:33.340895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19852): Terminated: ok {rc=0} 15:57:33.387244 --- ParallelTerminationStrategy: PID 19855 died... 15:57:33.406696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19855): Terminated: ok {rc=0} 15:57:33.494844 bus /sierra_3: Setting Powered False 15:57:34.593362 bus /sierra_3: Setting Powered False 15:57:35.708409 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:57:36.955296 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:57:36.960866 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:57:36.993818 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 15:57:37.020655 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 15:57:37.073831 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:57:37.108726 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 15:57:37.137260 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 15:57:37.684087 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 15:57:37.733990 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:37.745043 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:57:37.813863 tst mo_mt_call.py: using LAC 22125 15:57:37.932446 tst mo_mt_call.py: using RAC 195 15:57:38.050340 tst mo_mt_call.py: using CellId 22125 15:57:38.170216 tst mo_mt_call.py: using BVCI 22126 15:57:38.280311 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:38.291287 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:38.302120 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:38.312861 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:38.323741 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:38.334591 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:57:38.454651 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:57:38.577702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:39.086602 run create_hlr_db(pid=19861): Launched 15:57:39.214850 bus /sierra_2: Setting Powered False 15:57:40.275807 run create_hlr_db(pid=19861): Terminated: ok {rc=0} 15:57:40.735519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19863): Launched 15:57:41.064520 run osmo-hlr_10.42.42.2(pid=19864): Launched 15:57:41.189692 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:41.757046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19866): Launched 15:57:42.085987 run osmo-stp_10.42.42.5(pid=19867): Launched 15:57:42.212401 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:42.803950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19869): Launched 15:57:43.133623 run osmo-msc_10.42.42.6(pid=19870): Launched 15:57:43.318283 run osmo-stp_10.42.42.5(pid=19867): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19867)] 15:57:43.455761 run osmo-stp_10.42.42.5(pid=19867): stdout: | (launched: 2022-12-09_15:57:42.026364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:43.594341 run osmo-stp_10.42.42.5(pid=19867): stderr: | [0;m[38;5;43m20221209155742216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155742216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155742216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155742217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155742217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155742217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155742218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:43.731210 run osmo-stp_10.42.42.5(pid=19867): stdout: | (launched: 2022-12-09_15:57:42.026364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:43.861591 run osmo-stp_10.42.42.5(pid=19867): stderr: | [0;m[38;5;43m20221209155742216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155742216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155742216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155742217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155742217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155742217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155742218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:44.017842 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19867): Process ended prematurely: osmo-stp_10.42.42.5(pid=19867) [trial-2361↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19867)] [trial-2361↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 15:57:44.027239 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 15:57:44.055733 run osmo-hlr_10.42.42.2(pid=19864): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19864)] 15:57:44.106054 run osmo-hlr_10.42.42.2(pid=19864): stdout: | (launched: 2022-12-09_15:57:41.005481) 15:57:44.158553 run osmo-hlr_10.42.42.2(pid=19864): stderr: | [0;m[1;31m20221209155741201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155741201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155741201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155741201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155741201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155741202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155741214 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155741223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155741223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155741223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:44.231037 run osmo-msc_10.42.42.6(pid=19870): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19870)] 15:57:44.281249 run osmo-msc_10.42.42.6(pid=19870): stdout: | (launched: 2022-12-09_15:57:43.073788) 15:57:44.332930 run osmo-msc_10.42.42.6(pid=19870): stderr: | [0;m[38;5;43m20221209155743395 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155743395 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdc410dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155743395 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155743395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155743396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155743396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155743398 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155743398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155743398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155743398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:44.385242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19863): Terminating (SIGTERM) 15:57:44.427047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19866): Terminating (SIGTERM) 15:57:44.469250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19869): Terminating (SIGTERM) 15:57:44.511558 --- ParallelTerminationStrategy: PID 19863 died... 15:57:44.531592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19863): Terminated: ok {rc=0} 15:57:44.579133 --- ParallelTerminationStrategy: PID 19866 died... 15:57:44.598961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19866): Terminated: ok {rc=0} 15:57:44.645753 --- ParallelTerminationStrategy: PID 19869 died... 15:57:44.665492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19869): Terminated: ok {rc=0} 15:57:44.754848 bus /sierra_3: Setting Powered False 15:57:45.856433 bus /sierra_3: Setting Powered False 15:57:46.994396 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 15:57:48.154255 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:48.166728 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:57:48.239880 tst mo_mt_call_osmux.py: using LAC 22126 15:57:48.370710 tst mo_mt_call_osmux.py: using RAC 196 15:57:48.497944 tst mo_mt_call_osmux.py: using CellId 22126 15:57:48.626270 tst mo_mt_call_osmux.py: using BVCI 22127 15:57:48.744778 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:48.756210 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:48.767519 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:48.779038 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:48.790849 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:57:48.802451 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:57:48.921437 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:57:49.043106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:57:49.551140 run create_hlr_db(pid=19872): Launched 15:57:49.677437 bus /sierra_2: Setting Powered False 15:57:50.741983 run create_hlr_db(pid=19872): Terminated: ok {rc=0} 15:57:51.180349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19874): Launched 15:57:51.488480 run osmo-hlr_10.42.42.2(pid=19875): Launched 15:57:51.607839 run osmo-stp_10.42.42.5: Starting osmo-stp 15:57:52.176054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19877): Launched 15:57:52.485520 run osmo-stp_10.42.42.5(pid=19878): Launched 15:57:52.603376 run osmo-msc_10.42.42.6: Starting osmo-msc 15:57:53.158053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19880): Launched 15:57:53.467954 run osmo-msc_10.42.42.6(pid=19881): Launched 15:57:53.640108 run osmo-stp_10.42.42.5(pid=19878): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19878)] 15:57:53.770031 run osmo-stp_10.42.42.5(pid=19878): stdout: | (launched: 2022-12-09_15:57:52.429106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:53.900201 run osmo-stp_10.42.42.5(pid=19878): stderr: | [0;m[38;5;43m20221209155752600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155752601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155752601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155752601 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155752602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155752602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155752602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:54.028246 run osmo-stp_10.42.42.5(pid=19878): stdout: | (launched: 2022-12-09_15:57:52.429106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:57:54.150312 run osmo-stp_10.42.42.5(pid=19878): stderr: | [0;m[38;5;43m20221209155752600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155752601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155752601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155752601 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155752602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155752602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155752602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:57:54.296760 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19878): Process ended prematurely: osmo-stp_10.42.42.5(pid=19878) [trial-2361↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19878)] [trial-2361↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 15:57:54.305856 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:57:54.332430 run osmo-hlr_10.42.42.2(pid=19875): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19875)] 15:57:54.380502 run osmo-hlr_10.42.42.2(pid=19875): stdout: | (launched: 2022-12-09_15:57:51.432341) 15:57:54.430172 run osmo-hlr_10.42.42.2(pid=19875): stderr: | [0;m[1;31m20221209155751606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155751606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155751606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155751606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155751606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155751606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155751619 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155751628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155751629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155751629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:57:54.499399 run osmo-msc_10.42.42.6(pid=19881): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19881)] 15:57:54.547135 run osmo-msc_10.42.42.6(pid=19881): stdout: | (launched: 2022-12-09_15:57:53.411478) 15:57:54.596847 run osmo-msc_10.42.42.6(pid=19881): stderr: | [0;m[38;5;43m20221209155753683 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155753683 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f263f4e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155753683 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155753683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155753684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155753684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155753686 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155753686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155753686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155753686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:57:54.646527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19874): Terminating (SIGTERM) 15:57:54.686346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19877): Terminating (SIGTERM) 15:57:54.726016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19880): Terminating (SIGTERM) 15:57:54.766071 --- ParallelTerminationStrategy: PID 19874 died... 15:57:54.785362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19874): Terminated: ok {rc=0} 15:57:54.829946 --- ParallelTerminationStrategy: PID 19877 died... 15:57:54.848662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19877): Terminated: ok {rc=0} 15:57:54.893086 --- ParallelTerminationStrategy: PID 19880 died... 15:57:54.911776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19880): Terminated: ok {rc=0} 15:57:54.998853 bus /sierra_3: Setting Powered False 15:57:56.100003 bus /sierra_3: Setting Powered False 15:57:57.217239 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 15:57:58.471704 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:57:58.476625 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 15:57:58.509668 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 15:57:58.536367 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 15:57:58.590115 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 15:57:58.623386 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 15:57:58.650264 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 15:57:59.198663 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 15:57:59.248214 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:57:59.259530 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 15:57:59.315046 tst mo_mt_call.py: using LAC 22127 15:57:59.434714 tst mo_mt_call.py: using RAC 197 15:57:59.554709 tst mo_mt_call.py: using CellId 22127 15:57:59.674712 tst mo_mt_call.py: using BVCI 22128 15:57:59.786363 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:57:59.797526 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:57:59.808344 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:57:59.819253 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:57:59.830036 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:57:59.840865 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:57:59.960374 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:58:00.081566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:00.589372 run create_hlr_db(pid=19886): Launched 15:58:00.715031 bus /sierra_2: Setting Powered False 15:58:01.778161 run create_hlr_db(pid=19886): Terminated: ok {rc=0} 15:58:02.247174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19888): Launched 15:58:02.584294 run osmo-hlr_10.42.42.2(pid=19889): Launched 15:58:02.710068 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:03.278038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19891): Launched 15:58:03.606553 run osmo-stp_10.42.42.5(pid=19892): Launched 15:58:03.731423 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:04.325165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19894): Launched 15:58:04.654872 run osmo-msc_10.42.42.6(pid=19895): Launched 15:58:04.839554 run osmo-stp_10.42.42.5(pid=19892): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19892)] 15:58:04.978425 run osmo-stp_10.42.42.5(pid=19892): stdout: | (launched: 2022-12-09_15:58:03.546650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:05.118234 run osmo-stp_10.42.42.5(pid=19892): stderr: | [0;m[38;5;43m20221209155803738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155803738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155803738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155803738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155803739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155803739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155803739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:05.254899 run osmo-stp_10.42.42.5(pid=19892): stdout: | (launched: 2022-12-09_15:58:03.546650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:05.385165 run osmo-stp_10.42.42.5(pid=19892): stderr: | [0;m[38;5;43m20221209155803738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155803738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155803738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155803738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155803739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155803739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155803739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:05.541235 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19892): Process ended prematurely: osmo-stp_10.42.42.5(pid=19892) [trial-2361↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19892)] [trial-2361↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 15:58:05.550934 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 15:58:05.579438 run osmo-hlr_10.42.42.2(pid=19889): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19889)] 15:58:05.629869 run osmo-hlr_10.42.42.2(pid=19889): stdout: | (launched: 2022-12-09_15:58:02.525140) 15:58:05.682013 run osmo-hlr_10.42.42.2(pid=19889): stderr: | [0;m[1;31m20221209155802722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155802722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155802722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155802722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155802722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155802722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155802734 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155802742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155802743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155802743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:05.754292 run osmo-msc_10.42.42.6(pid=19895): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19895)] 15:58:05.804868 run osmo-msc_10.42.42.6(pid=19895): stdout: | (launched: 2022-12-09_15:58:04.595184) 15:58:05.856662 run osmo-msc_10.42.42.6(pid=19895): stderr: | [0;m[38;5;43m20221209155804914 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155804914 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa874cd4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155804915 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155804915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155804915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155804915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155804917 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155804918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155804918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155804918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:05.909191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19888): Terminating (SIGTERM) 15:58:05.951295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19891): Terminating (SIGTERM) 15:58:05.993820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19894): Terminating (SIGTERM) 15:58:06.036752 --- ParallelTerminationStrategy: PID 19888 died... 15:58:06.057087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19888): Terminated: ok {rc=0} 15:58:06.104402 --- ParallelTerminationStrategy: PID 19891 died... 15:58:06.124210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19891): Terminated: ok {rc=0} 15:58:06.171472 --- ParallelTerminationStrategy: PID 19894 died... 15:58:06.191280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19894): Terminated: ok {rc=0} 15:58:06.279674 bus /sierra_3: Setting Powered False 15:58:07.380041 bus /sierra_3: Setting Powered False 15:58:08.498734 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 15:58:09.648202 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:09.660070 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 15:58:09.710854 tst mo_mt_call_osmux.py: using LAC 22128 15:58:09.831524 tst mo_mt_call_osmux.py: using RAC 198 15:58:09.953285 tst mo_mt_call_osmux.py: using CellId 22128 15:58:10.074837 tst mo_mt_call_osmux.py: using BVCI 22129 15:58:10.185363 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:10.196519 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:10.207441 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:10.218500 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:10.229536 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:58:10.240522 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:58:10.359978 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:58:10.480334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:10.956829 run create_hlr_db(pid=19897): Launched 15:58:11.083657 bus /sierra_2: Setting Powered False 15:58:12.144462 run create_hlr_db(pid=19897): Terminated: ok {rc=0} 15:58:12.594152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19899): Launched 15:58:12.925960 run osmo-hlr_10.42.42.2(pid=19900): Launched 15:58:13.051565 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:13.619255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19902): Launched 15:58:13.951260 run osmo-stp_10.42.42.5(pid=19903): Launched 15:58:14.076439 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:14.670857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19905): Launched 15:58:15.002023 run osmo-msc_10.42.42.6(pid=19906): Launched 15:58:15.186382 run osmo-stp_10.42.42.5(pid=19903): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19903)] 15:58:15.323551 run osmo-stp_10.42.42.5(pid=19903): stdout: | (launched: 2022-12-09_15:58:13.891303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:15.461787 run osmo-stp_10.42.42.5(pid=19903): stderr: | [0;m[38;5;43m20221209155814083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155814083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155814083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155814084 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155814084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155814084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155814084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:15.598794 run osmo-stp_10.42.42.5(pid=19903): stdout: | (launched: 2022-12-09_15:58:13.891303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:15.729186 run osmo-stp_10.42.42.5(pid=19903): stderr: | [0;m[38;5;43m20221209155814083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155814083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155814083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155814084 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155814084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155814084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155814084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:15.893500 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19903): Process ended prematurely: osmo-stp_10.42.42.5(pid=19903) [trial-2361↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19903)] [trial-2361↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 15:58:15.904463 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:58:15.934160 run osmo-hlr_10.42.42.2(pid=19900): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19900)] 15:58:15.985880 run osmo-hlr_10.42.42.2(pid=19900): stdout: | (launched: 2022-12-09_15:58:12.866123) 15:58:16.039192 run osmo-hlr_10.42.42.2(pid=19900): stderr: | [0;m[1;31m20221209155813063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155813063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155813063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155813063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155813063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155813063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155813077 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155813085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155813085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155813085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:16.113179 run osmo-msc_10.42.42.6(pid=19906): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19906)] 15:58:16.164754 run osmo-msc_10.42.42.6(pid=19906): stdout: | (launched: 2022-12-09_15:58:14.942139) 15:58:16.218021 run osmo-msc_10.42.42.6(pid=19906): stderr: | [0;m[38;5;43m20221209155815265 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155815265 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f048157fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155815265 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155815265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155815265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155815266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155815267 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155815268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155815268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155815268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:16.271331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19899): Terminating (SIGTERM) 15:58:16.314254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19902): Terminating (SIGTERM) 15:58:16.357353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19905): Terminating (SIGTERM) 15:58:16.400658 --- ParallelTerminationStrategy: PID 19899 died... 15:58:16.421149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19899): Terminated: ok {rc=0} 15:58:16.469103 --- ParallelTerminationStrategy: PID 19902 died... 15:58:16.489305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19902): Terminated: ok {rc=0} 15:58:16.536821 --- ParallelTerminationStrategy: PID 19905 died... 15:58:16.556838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19905): Terminated: ok {rc=0} 15:58:16.651904 bus /sierra_3: Setting Powered False 15:58:17.761554 bus /sierra_3: Setting Powered False 15:58:18.878654 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 15:58:20.130508 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:58:20.136765 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 15:58:20.170405 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 15:58:20.197036 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 15:58:20.250176 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 15:58:20.283748 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 15:58:20.310352 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 15:58:20.862476 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 15:58:20.911929 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:20.923499 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 15:58:20.976746 tst mo_mt_call.py: using LAC 22129 15:58:21.097514 tst mo_mt_call.py: using RAC 199 15:58:21.229269 tst mo_mt_call.py: using CellId 22129 15:58:21.357649 tst mo_mt_call.py: using BVCI 22130 15:58:21.470666 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:21.482217 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:21.493701 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:21.505313 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:21.516788 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:21.528380 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 15:58:21.649731 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 15:58:21.769972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:22.247888 run create_hlr_db(pid=19911): Launched 15:58:22.373870 bus /sierra_2: Setting Powered False 15:58:23.435717 run create_hlr_db(pid=19911): Terminated: ok {rc=0} 15:58:23.885534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19913): Launched 15:58:24.214175 run osmo-hlr_10.42.42.2(pid=19914): Launched 15:58:24.341535 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:24.909306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19916): Launched 15:58:25.239272 run osmo-stp_10.42.42.5(pid=19917): Launched 15:58:25.366988 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:25.961949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19919): Launched 15:58:26.291996 run osmo-msc_10.42.42.6(pid=19920): Launched 15:58:26.475394 run osmo-stp_10.42.42.5(pid=19917): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19917)] 15:58:26.614458 run osmo-stp_10.42.42.5(pid=19917): stdout: | (launched: 2022-12-09_15:58:25.179329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:26.753803 run osmo-stp_10.42.42.5(pid=19917): stderr: | [0;m[38;5;43m20221209155825372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155825372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155825372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155825373 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155825373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155825373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155825373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:26.891585 run osmo-stp_10.42.42.5(pid=19917): stdout: | (launched: 2022-12-09_15:58:25.179329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:27.022628 run osmo-stp_10.42.42.5(pid=19917): stderr: | [0;m[38;5;43m20221209155825372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155825372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155825372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155825373 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155825373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155825373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155825373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:27.179923 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19917): Process ended prematurely: osmo-stp_10.42.42.5(pid=19917) [trial-2361↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19917)] [trial-2361↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 15:58:27.189846 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 15:58:27.218641 run osmo-hlr_10.42.42.2(pid=19914): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19914)] 15:58:27.269406 run osmo-hlr_10.42.42.2(pid=19914): stdout: | (launched: 2022-12-09_15:58:24.155049) 15:58:27.321766 run osmo-hlr_10.42.42.2(pid=19914): stderr: | [0;m[1;31m20221209155824352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155824352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155824352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155824352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155824352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155824352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155824365 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155824373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155824373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155824374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:27.394539 run osmo-msc_10.42.42.6(pid=19920): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19920)] 15:58:27.445100 run osmo-msc_10.42.42.6(pid=19920): stdout: | (launched: 2022-12-09_15:58:26.231658) 15:58:27.497698 run osmo-msc_10.42.42.6(pid=19920): stderr: | [0;m[38;5;43m20221209155826554 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155826554 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f06638b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155826554 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155826555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155826555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155826555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155826557 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155826557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155826557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155826557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:27.550511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19913): Terminating (SIGTERM) 15:58:27.592867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19916): Terminating (SIGTERM) 15:58:27.635372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19919): Terminating (SIGTERM) 15:58:27.678195 --- ParallelTerminationStrategy: PID 19913 died... 15:58:27.698367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19913): Terminated: ok {rc=0} 15:58:27.745715 --- ParallelTerminationStrategy: PID 19916 died... 15:58:27.765505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19916): Terminated: ok {rc=0} 15:58:27.812882 --- ParallelTerminationStrategy: PID 19919 died... 15:58:27.832715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19919): Terminated: ok {rc=0} 15:58:27.921567 bus /sierra_3: Setting Powered False 15:58:29.021962 bus /sierra_3: Setting Powered False 15:58:30.138928 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 15:58:31.290472 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:31.304192 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 15:58:31.361550 tst mo_mt_call_osmux.py: using LAC 22130 15:58:31.509634 tst mo_mt_call_osmux.py: using RAC 200 15:58:31.639192 tst mo_mt_call_osmux.py: using CellId 22130 15:58:31.762304 tst mo_mt_call_osmux.py: using BVCI 22131 15:58:31.886947 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:31.899549 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:31.913623 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:31.927526 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:31.940288 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:58:31.953890 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 15:58:32.100524 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 15:58:32.231513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:32.742998 run create_hlr_db(pid=19922): Launched 15:58:32.869237 bus /sierra_2: Setting Powered False 15:58:33.934295 run create_hlr_db(pid=19922): Terminated: ok {rc=0} 15:58:34.375564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19924): Launched 15:58:34.685726 run osmo-hlr_10.42.42.2(pid=19925): Launched 15:58:34.803276 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:35.346124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19927): Launched 15:58:35.654820 run osmo-stp_10.42.42.5(pid=19928): Launched 15:58:35.772775 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:36.325063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19930): Launched 15:58:36.632745 run osmo-msc_10.42.42.6(pid=19931): Launched 15:58:36.804038 run osmo-stp_10.42.42.5(pid=19928): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19928)] 15:58:36.933491 run osmo-stp_10.42.42.5(pid=19928): stdout: | (launched: 2022-12-09_15:58:35.598494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:37.063848 run osmo-stp_10.42.42.5(pid=19928): stderr: | [0;m[38;5;43m20221209155835768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155835768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155835769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155835769 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155835770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155835770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155835770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:37.191398 run osmo-stp_10.42.42.5(pid=19928): stdout: | (launched: 2022-12-09_15:58:35.598494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:37.312438 run osmo-stp_10.42.42.5(pid=19928): stderr: | [0;m[38;5;43m20221209155835768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155835768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155835769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155835769 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155835770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155835770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155835770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:37.458472 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19928): Process ended prematurely: osmo-stp_10.42.42.5(pid=19928) [trial-2361↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19928)] [trial-2361↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 15:58:37.467241 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:58:37.493605 run osmo-hlr_10.42.42.2(pid=19925): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19925)] 15:58:37.541496 run osmo-hlr_10.42.42.2(pid=19925): stdout: | (launched: 2022-12-09_15:58:34.629139) 15:58:37.591531 run osmo-hlr_10.42.42.2(pid=19925): stderr: | [0;m[1;31m20221209155834805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155834805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155834805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155834805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155834806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155834806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155834818 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155834829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155834829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155834829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:37.660306 run osmo-msc_10.42.42.6(pid=19931): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19931)] 15:58:37.707777 run osmo-msc_10.42.42.6(pid=19931): stdout: | (launched: 2022-12-09_15:58:36.576580) 15:58:37.756769 run osmo-msc_10.42.42.6(pid=19931): stderr: | [0;m[38;5;43m20221209155836849 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155836849 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f754e951c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155836849 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155836849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155836849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155836849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155836851 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155836851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155836852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155836852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:37.806153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19924): Terminating (SIGTERM) 15:58:37.845994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19927): Terminating (SIGTERM) 15:58:37.886160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19930): Terminating (SIGTERM) 15:58:37.926160 --- ParallelTerminationStrategy: PID 19924 died... 15:58:37.945258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19924): Terminated: ok {rc=0} 15:58:37.989069 --- ParallelTerminationStrategy: PID 19927 died... 15:58:38.007835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19927): Terminated: ok {rc=0} 15:58:38.052189 --- ParallelTerminationStrategy: PID 19930 died... 15:58:38.070747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19930): Terminated: ok {rc=0} 15:58:38.155638 bus /sierra_3: Setting Powered False 15:58:39.254748 bus /sierra_3: Setting Powered False 15:58:40.375081 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 emergency:trx-b200 --------------------------------------------------------------------- 15:58:41.628084 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:58:41.632607 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 15:58:41.665500 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 15:58:41.692286 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 15:58:41.777761 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 15:58:41.810448 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 15:58:41.836907 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 15:58:42.421754 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2361 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 15:58:42.426567 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:42.437348 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 15:58:42.486893 tst emergency_mo_mt_call.py: using LAC 22131 15:58:42.604659 tst emergency_mo_mt_call.py: using RAC 201 15:58:42.722811 tst emergency_mo_mt_call.py: using CellId 22131 15:58:42.842343 tst emergency_mo_mt_call.py: using BVCI 22132 15:58:42.953309 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:42.963947 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:42.974566 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:42.985060 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:42.995508 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:43.006007 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:58:43.124728 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:58:43.242524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:43.711511 run create_hlr_db(pid=19937): Launched 15:58:43.835360 bus /sierra_2: Setting Powered False 15:58:44.895288 run create_hlr_db(pid=19937): Terminated: ok {rc=0} 15:58:45.337566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19939): Launched 15:58:45.661145 run osmo-hlr_10.42.42.2(pid=19940): Launched 15:58:45.785479 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:46.454743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19942): Launched 15:58:46.792653 run osmo-stp_10.42.42.5(pid=19943): Launched 15:58:47.083107 tst emergency_mo_mt_call.py: using MSISDN 7261 15:58:47.259176 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:47.806397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19945): Launched 15:58:48.110916 run osmo-msc_10.42.42.6(pid=19946): Launched 15:58:48.278640 run osmo-stp_10.42.42.5(pid=19943): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19943)] 15:58:48.404510 run osmo-stp_10.42.42.5(pid=19943): stdout: | (launched: 2022-12-09_15:58:46.733564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:48.531505 run osmo-stp_10.42.42.5(pid=19943): stderr: | [0;m[38;5;43m20221209155846932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155846932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155846932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155846933 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155846933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155846933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155846933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:48.656275 run osmo-stp_10.42.42.5(pid=19943): stdout: | (launched: 2022-12-09_15:58:46.733564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:48.776153 run osmo-stp_10.42.42.5(pid=19943): stderr: | [0;m[38;5;43m20221209155846932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155846932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155846932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155846933 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155846933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155846933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155846933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:48.919551 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=19943): Process ended prematurely: osmo-stp_10.42.42.5(pid=19943) [trial-2361↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19943)] [trial-2361↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 15:58:48.928026 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 15:58:48.954150 run osmo-hlr_10.42.42.2(pid=19940): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19940)] 15:58:49.001800 run osmo-hlr_10.42.42.2(pid=19940): stdout: | (launched: 2022-12-09_15:58:45.602063) 15:58:49.050868 run osmo-hlr_10.42.42.2(pid=19940): stderr: | [0;m[1;31m20221209155845798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155845798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155845798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155845798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155845798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155845798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155845811 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155845821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155845821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155845822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:49.119555 run osmo-msc_10.42.42.6(pid=19946): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19946)] 15:58:49.167226 run osmo-msc_10.42.42.6(pid=19946): stdout: | (launched: 2022-12-09_15:58:48.055213) 15:58:49.217267 run osmo-msc_10.42.42.6(pid=19946): stderr: | [0;m[38;5;43m20221209155848328 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155848328 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2da23d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155848329 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155848329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155848329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155848329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155848331 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155848331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155848331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155848332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:49.266717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19939): Terminating (SIGTERM) 15:58:49.306528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19942): Terminating (SIGTERM) 15:58:49.346604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19945): Terminating (SIGTERM) 15:58:49.386660 --- ParallelTerminationStrategy: PID 19939 died... 15:58:49.405843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19939): Terminated: ok {rc=0} 15:58:49.449911 --- ParallelTerminationStrategy: PID 19942 died... 15:58:49.468414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19942): Terminated: ok {rc=0} 15:58:49.512753 --- ParallelTerminationStrategy: PID 19945 died... 15:58:49.531465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19945): Terminated: ok {rc=0} 15:58:49.615219 bus /sierra_3: Setting Powered False 15:58:50.713863 bus /sierra_3: Setting Powered False 15:58:51.833448 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 15:58:52.920903 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:52.932603 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 15:58:52.982437 tst emergency_preemptive_call.py: using LAC 22132 15:58:53.100907 tst emergency_preemptive_call.py: using RAC 202 15:58:53.216866 tst emergency_preemptive_call.py: using CellId 22132 15:58:53.333293 tst emergency_preemptive_call.py: using BVCI 22133 15:58:53.441721 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:53.452415 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:53.463041 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:53.473600 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:53.484110 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:58:53.494612 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:58:53.615064 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:58:53.733258 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:58:53.853253 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:58:53.969024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:58:54.437818 run create_hlr_db(pid=19948): Launched 15:58:54.561605 bus /sierra_2: Setting Powered False 15:58:55.622432 run create_hlr_db(pid=19948): Terminated: ok {rc=0} 15:58:56.064856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19950): Launched 15:58:56.388121 run osmo-hlr_10.42.42.2(pid=19951): Launched 15:58:56.510952 run osmo-stp_10.42.42.5: Starting osmo-stp 15:58:57.069225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19953): Launched 15:58:57.391815 run osmo-stp_10.42.42.5(pid=19954): Launched 15:58:57.526066 tst emergency_preemptive_call.py: using MSISDN 7262 15:58:57.693953 run osmo-msc_10.42.42.6: Starting osmo-msc 15:58:58.271951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19956): Launched 15:58:58.594518 run osmo-msc_10.42.42.6(pid=19957): Launched 15:58:58.775782 run osmo-stp_10.42.42.5(pid=19954): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19954)] 15:58:58.913296 run osmo-stp_10.42.42.5(pid=19954): stdout: | (launched: 2022-12-09_15:58:57.333130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:59.049893 run osmo-stp_10.42.42.5(pid=19954): stderr: | [0;m[38;5;43m20221209155857525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155857525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155857526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155857526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155857527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155857527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155857527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:59.184722 run osmo-stp_10.42.42.5(pid=19954): stdout: | (launched: 2022-12-09_15:58:57.333130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:58:59.313372 run osmo-stp_10.42.42.5(pid=19954): stderr: | [0;m[38;5;43m20221209155857525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155857525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155857526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155857526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155857527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155857527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155857527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:58:59.467538 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=19954): Process ended prematurely: osmo-stp_10.42.42.5(pid=19954) [trial-2361↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19954)] [trial-2361↪emergency:trx-b200↪emergency_preemptive_call.py:32] 15:58:59.476750 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 15:58:59.505663 run osmo-hlr_10.42.42.2(pid=19951): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19951)] 15:58:59.556936 run osmo-hlr_10.42.42.2(pid=19951): stdout: | (launched: 2022-12-09_15:58:56.329439) 15:58:59.610012 run osmo-hlr_10.42.42.2(pid=19951): stderr: | [0;m[1;31m20221209155856525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155856525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155856525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155856525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155856525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155856525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155856538 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155856546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155856546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155856546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:58:59.683807 run osmo-msc_10.42.42.6(pid=19957): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19957)] 15:58:59.734555 run osmo-msc_10.42.42.6(pid=19957): stdout: | (launched: 2022-12-09_15:58:58.535275) 15:58:59.787428 run osmo-msc_10.42.42.6(pid=19957): stderr: | [0;m[38;5;43m20221209155858855 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209155858855 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5faf605c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209155858855 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209155858855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209155858855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209155858855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209155858858 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209155858859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209155858859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209155858859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:58:59.840652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19950): Terminating (SIGTERM) 15:58:59.883568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19953): Terminating (SIGTERM) 15:58:59.926366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19956): Terminating (SIGTERM) 15:58:59.969383 --- ParallelTerminationStrategy: PID 19950 died... 15:58:59.989608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19950): Terminated: ok {rc=0} 15:59:00.037401 --- ParallelTerminationStrategy: PID 19953 died... 15:59:00.057226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19953): Terminated: ok {rc=0} 15:59:00.104699 --- ParallelTerminationStrategy: PID 19956 died... 15:59:00.124611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19956): Terminated: ok {rc=0} 15:59:00.214757 bus /sierra_9: Setting Powered False 15:59:01.313782 bus /sierra_9: Setting Powered False 15:59:02.433709 bus /sierra_8: Setting Powered False 15:59:03.534399 bus /sierra_8: Setting Powered False 15:59:04.650541 bus /sierra_3: Setting Powered False 15:59:05.750991 bus /sierra_3: Setting Powered False 15:59:06.868729 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-b200 --------------------------------------------------------------------- 15:59:08.154035 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:59:08.159489 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 15:59:08.193707 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 15:59:08.232339 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 15:59:08.319104 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 15:59:08.351943 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 15:59:08.390088 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 15:59:08.985675 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 15:59:09.040362 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:09.051733 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 15:59:09.102413 tst cs_paging_gprs_active.py: using LAC 22133 15:59:09.231842 tst cs_paging_gprs_active.py: using RAC 203 15:59:09.362749 tst cs_paging_gprs_active.py: using CellId 22133 15:59:09.494092 tst cs_paging_gprs_active.py: using BVCI 22134 15:59:09.615304 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:09.626520 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:09.637599 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:09.648940 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:09.660165 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:09.671434 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:09.683119 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:09.694629 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:09.706270 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:09.824802 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:09.945445 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:59:10.170123 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:59:10.502525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19964): Launched 15:59:10.790553 run iperf3-srv_10.42.42.10(pid=19965): Launched 15:59:10.915391 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:59:11.138955 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:59:11.470918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19966): Launched 15:59:11.759609 run iperf3-srv_10.42.42.10(pid=19967): Launched 15:59:11.884538 tst cs_paging_gprs_active.py:38: start network... 15:59:12.107663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:59:12.618551 run create_hlr_db(pid=19968): Launched 15:59:12.746161 bus /sierra_2: Setting Powered False 15:59:13.811649 run create_hlr_db(pid=19968): Terminated: ok {rc=0} 15:59:14.251765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19970): Launched 15:59:14.561026 run osmo-hlr_10.42.42.2(pid=19971): Launched 15:59:14.680929 run osmo-stp_10.42.42.5: Starting osmo-stp 15:59:15.216200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19973): Launched 15:59:15.525382 run osmo-stp_10.42.42.5(pid=19974): Launched 15:59:15.643434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:59:16.210943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19976): Launched 15:59:16.382207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:59:16.650381 run patchelf(pid=19977): Launched 15:59:16.840152 run osmo-stp_10.42.42.5(pid=19974): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19974)] 15:59:16.974826 run osmo-stp_10.42.42.5(pid=19974): stdout: | (launched: 2022-12-09_15:59:15.468685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:17.111114 run osmo-stp_10.42.42.5(pid=19974): stderr: | [0;m[38;5;43m20221209155915636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155915636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155915636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155915637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155915637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155915637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155915637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:17.247245 run osmo-stp_10.42.42.5(pid=19974): stdout: | (launched: 2022-12-09_15:59:15.468685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:17.374827 run osmo-stp_10.42.42.5(pid=19974): stderr: | [0;m[38;5;43m20221209155915636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155915636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155915636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155915637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155915637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155915637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155915637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:17.525055 run patchelf(pid=19977): Terminating (SIGINT) 15:59:17.698963 run patchelf(pid=19977): Terminated: ok {rc=0} 15:59:17.824174 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19974): Process ended prematurely: osmo-stp_10.42.42.5(pid=19974) [trial-2361↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19974)] [trial-2361↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 15:59:17.834076 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 15:59:17.861636 run osmo-hlr_10.42.42.2(pid=19971): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19971)] 15:59:17.910189 run osmo-hlr_10.42.42.2(pid=19971): stdout: | (launched: 2022-12-09_15:59:14.504397) 15:59:17.959774 run osmo-hlr_10.42.42.2(pid=19971): stderr: | [0;m[1;31m20221209155914681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155914681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155914681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155914681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155914681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155914681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155914693 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155914703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155914703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155914703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:59:18.009829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19964): Terminating (SIGTERM) 15:59:18.050030 run iperf3-srv_10.42.42.10(pid=19965): Terminating (SIGTERM) 15:59:18.090306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19966): Terminating (SIGTERM) 15:59:18.130511 run iperf3-srv_10.42.42.10(pid=19967): Terminating (SIGTERM) 15:59:18.170551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19970): Terminating (SIGTERM) 15:59:18.210750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19973): Terminating (SIGTERM) 15:59:18.251155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19976): Terminating (SIGTERM) 15:59:18.291680 --- ParallelTerminationStrategy: PID 19964 died... 15:59:18.311053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19964): Terminated: ok {rc=0} 15:59:18.356232 --- ParallelTerminationStrategy: PID 19965 died... 15:59:18.375201 run iperf3-srv_10.42.42.10(pid=19965): Terminated {rc=256} 15:59:18.419289 --- ParallelTerminationStrategy: PID 19966 died... 15:59:18.438038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19966): Terminated: ok {rc=0} 15:59:18.482415 --- ParallelTerminationStrategy: PID 19967 died... 15:59:18.501361 run iperf3-srv_10.42.42.10(pid=19967): Terminated {rc=256} 15:59:18.545997 --- ParallelTerminationStrategy: PID 19970 died... 15:59:18.565043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19970): Terminated: ok {rc=0} 15:59:18.609437 --- ParallelTerminationStrategy: PID 19973 died... 15:59:18.628291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19973): Terminated: ok {rc=0} 15:59:18.672713 --- ParallelTerminationStrategy: PID 19976 died... 15:59:18.691670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19976): Terminated: ok {rc=0} 15:59:18.776616 bus /gobi_0: Setting Powered False 15:59:19.876248 bus /gobi_0: Setting Powered False 15:59:20.993337 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200 iperf3.py ---------------------------------------------- 15:59:22.145134 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:22.157115 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 15:59:22.210610 tst iperf3.py: using LAC 22134 15:59:22.340521 tst iperf3.py: using RAC 204 15:59:22.468546 tst iperf3.py: using CellId 22134 15:59:22.598774 tst iperf3.py: using BVCI 22135 15:59:22.719904 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:22.731238 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:22.742284 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:22.753575 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:22.764307 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:22.775792 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:22.787235 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:22.798414 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:22.809775 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:22.930152 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:59:23.153355 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:59:23.483988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19978): Launched 15:59:23.771715 run iperf3-srv_10.42.42.10(pid=19979): Launched 15:59:23.895793 tst iperf3.py:8: start network... 15:59:24.119530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:59:24.627553 run create_hlr_db(pid=19980): Launched 15:59:24.752568 bus /gobi_6: Setting Powered False 15:59:25.816886 run create_hlr_db(pid=19980): Terminated: ok {rc=0} 15:59:26.256488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19982): Launched 15:59:26.563424 run osmo-hlr_10.42.42.2(pid=19983): Launched 15:59:26.682266 run osmo-stp_10.42.42.5: Starting osmo-stp 15:59:27.213970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19985): Launched 15:59:27.522921 run osmo-stp_10.42.42.5(pid=19986): Launched 15:59:27.643181 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:59:28.174628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19988): Launched 15:59:28.293362 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:59:28.554308 run patchelf(pid=19989): Launched 15:59:28.727286 run osmo-stp_10.42.42.5(pid=19986): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19986)] 15:59:28.857465 run osmo-stp_10.42.42.5(pid=19986): stdout: | (launched: 2022-12-09_15:59:27.465890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:28.989702 run osmo-stp_10.42.42.5(pid=19986): stderr: | [0;m[38;5;43m20221209155927635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155927635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155927635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155927636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155927636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155927636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155927637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:29.121652 run osmo-stp_10.42.42.5(pid=19986): stdout: | (launched: 2022-12-09_15:59:27.465890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:29.247469 run osmo-stp_10.42.42.5(pid=19986): stderr: | [0;m[38;5;43m20221209155927635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155927635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155927635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155927636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155927636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155927636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155927637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:29.396201 run patchelf(pid=19989): Terminating (SIGINT) 15:59:29.568330 run patchelf(pid=19989): Terminated: ok {rc=0} 15:59:29.692600 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19986): Process ended prematurely: osmo-stp_10.42.42.5(pid=19986) [trial-2361↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19986)] [trial-2361↪gprs:trx-b200↪iperf3.py:8] 15:59:29.702229 tst iperf3.py:8: Test FAILED (7.6 sec) 15:59:29.729644 run osmo-hlr_10.42.42.2(pid=19983): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19983)] 15:59:29.777160 run osmo-hlr_10.42.42.2(pid=19983): stdout: | (launched: 2022-12-09_15:59:26.507294) 15:59:29.826281 run osmo-hlr_10.42.42.2(pid=19983): stderr: | [0;m[1;31m20221209155926682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155926682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155926682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155926682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155926682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155926682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155926733 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155926742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155926743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155926743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:59:29.875755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19978): Terminating (SIGTERM) 15:59:29.915701 run iperf3-srv_10.42.42.10(pid=19979): Terminating (SIGTERM) 15:59:29.955305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19982): Terminating (SIGTERM) 15:59:29.995597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19985): Terminating (SIGTERM) 15:59:30.035400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19988): Terminating (SIGTERM) 15:59:30.075442 --- ParallelTerminationStrategy: PID 19978 died... 15:59:30.094479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19978): Terminated: ok {rc=0} 15:59:30.138547 --- ParallelTerminationStrategy: PID 19979 died... 15:59:30.157121 run iperf3-srv_10.42.42.10(pid=19979): Terminated {rc=256} 15:59:30.200746 --- ParallelTerminationStrategy: PID 19982 died... 15:59:30.219409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19982): Terminated: ok {rc=0} 15:59:30.262917 --- ParallelTerminationStrategy: PID 19985 died... 15:59:30.281586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19985): Terminated: ok {rc=0} 15:59:30.325361 --- ParallelTerminationStrategy: PID 19988 died... 15:59:30.344000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19988): Terminated: ok {rc=0} 15:59:30.427177 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 15:59:31.575410 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:31.588129 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 15:59:31.639759 tst iperf3m4.py: using LAC 22135 15:59:31.775608 tst iperf3m4.py: using RAC 205 15:59:31.903767 tst iperf3m4.py: using CellId 22135 15:59:32.027597 tst iperf3m4.py: using BVCI 22136 15:59:32.176467 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:32.187808 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:32.198838 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:32.210105 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:32.221824 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:32.232869 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:32.244264 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:32.255426 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:32.266990 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:32.383364 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:32.505975 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:32.626148 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:32.748364 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:59:32.973526 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:59:33.305384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19990): Launched 15:59:33.593312 run iperf3-srv_10.42.42.10(pid=19991): Launched 15:59:33.719338 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:59:33.942297 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:59:34.273763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19993): Launched 15:59:34.559871 run iperf3-srv_10.42.42.10(pid=19994): Launched 15:59:34.683358 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:59:34.906958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:59:35.237230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19995): Launched 15:59:35.523979 run iperf3-srv_10.42.42.10(pid=19996): Launched 15:59:35.649308 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:59:35.872327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:59:36.203407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19997): Launched 15:59:36.491211 run iperf3-srv_10.42.42.10(pid=19998): Launched 15:59:36.614674 tst iperf3m4.py:8: start network... 15:59:36.837664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:59:37.348228 run create_hlr_db(pid=19999): Launched 15:59:37.473889 bus /gobi_6: Setting Powered False 15:59:38.535271 run create_hlr_db(pid=19999): Terminated: ok {rc=0} 15:59:38.964177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20001): Launched 15:59:39.274288 run osmo-hlr_10.42.42.2(pid=20002): Launched 15:59:39.391456 run osmo-stp_10.42.42.5: Starting osmo-stp 15:59:39.931596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20004): Launched 15:59:40.241753 run osmo-stp_10.42.42.5(pid=20005): Launched 15:59:40.359138 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:59:40.889221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20007): Launched 15:59:41.007663 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:59:41.268482 run patchelf(pid=20008): Launched 15:59:41.442121 run osmo-stp_10.42.42.5(pid=20005): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20005)] 15:59:41.572921 run osmo-stp_10.42.42.5(pid=20005): stdout: | (launched: 2022-12-09_15:59:40.185180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:41.705403 run osmo-stp_10.42.42.5(pid=20005): stderr: | [0;m[38;5;43m20221209155940354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155940354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155940354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155940355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155940355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155940355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155940355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:41.837578 run osmo-stp_10.42.42.5(pid=20005): stdout: | (launched: 2022-12-09_15:59:40.185180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:41.963357 run osmo-stp_10.42.42.5(pid=20005): stderr: | [0;m[38;5;43m20221209155940354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155940354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155940354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155940355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155940355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155940355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155940355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:42.114120 run patchelf(pid=20008): Terminating (SIGINT) 15:59:42.287780 run patchelf(pid=20008): Terminated: ok {rc=0} 15:59:42.412738 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20005): Process ended prematurely: osmo-stp_10.42.42.5(pid=20005) [trial-2361↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20005)] [trial-2361↪gprs:trx-b200↪iperf3m4.py:8] 15:59:42.422356 tst iperf3m4.py:8: Test FAILED (10.9 sec) 15:59:42.450096 run osmo-hlr_10.42.42.2(pid=20002): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20002)] 15:59:42.498336 run osmo-hlr_10.42.42.2(pid=20002): stdout: | (launched: 2022-12-09_15:59:39.217046) 15:59:42.547997 run osmo-hlr_10.42.42.2(pid=20002): stderr: | [0;m[1;31m20221209155939390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155939390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155939391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155939391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155939391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155939391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155939403 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155939411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155939412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155939412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:59:42.598247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19990): Terminating (SIGTERM) 15:59:42.638509 run iperf3-srv_10.42.42.10(pid=19991): Terminating (SIGTERM) 15:59:42.678768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19993): Terminating (SIGTERM) 15:59:42.719098 run iperf3-srv_10.42.42.10(pid=19994): Terminating (SIGTERM) 15:59:42.759439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19995): Terminating (SIGTERM) 15:59:42.799645 run iperf3-srv_10.42.42.10(pid=19996): Terminating (SIGTERM) 15:59:42.839776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19997): Terminating (SIGTERM) 15:59:42.879978 run iperf3-srv_10.42.42.10(pid=19998): Terminating (SIGTERM) 15:59:42.919903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20001): Terminating (SIGTERM) 15:59:42.960010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20004): Terminating (SIGTERM) 15:59:43.000013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20007): Terminating (SIGTERM) 15:59:43.040440 --- ParallelTerminationStrategy: PID 19990 died... 15:59:43.059864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19990): Terminated: ok {rc=0} 15:59:43.104616 --- ParallelTerminationStrategy: PID 19991 died... 15:59:43.123681 run iperf3-srv_10.42.42.10(pid=19991): Terminated {rc=256} 15:59:43.168014 --- ParallelTerminationStrategy: PID 19993 died... 15:59:43.187016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19993): Terminated: ok {rc=0} 15:59:43.231353 --- ParallelTerminationStrategy: PID 19994 died... 15:59:43.250311 run iperf3-srv_10.42.42.10(pid=19994): Terminated {rc=256} 15:59:43.294136 --- ParallelTerminationStrategy: PID 19995 died... 15:59:43.312800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19995): Terminated: ok {rc=0} 15:59:43.357442 --- ParallelTerminationStrategy: PID 19996 died... 15:59:43.376172 run iperf3-srv_10.42.42.10(pid=19996): Terminated {rc=256} 15:59:43.419938 --- ParallelTerminationStrategy: PID 19997 died... 15:59:43.438610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19997): Terminated: ok {rc=0} 15:59:43.482435 --- ParallelTerminationStrategy: PID 19998 died... 15:59:43.501173 run iperf3-srv_10.42.42.10(pid=19998): Terminated {rc=256} 15:59:43.544842 --- ParallelTerminationStrategy: PID 20001 died... 15:59:43.563894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20001): Terminated: ok {rc=0} 15:59:43.607842 --- ParallelTerminationStrategy: PID 20004 died... 15:59:43.626686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20004): Terminated: ok {rc=0} 15:59:43.670600 --- ParallelTerminationStrategy: PID 20007 died... 15:59:43.689319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20007): Terminated: ok {rc=0} 15:59:43.775638 bus /gobi_4: Setting Powered False 15:59:44.877161 bus /gobi_4: Setting Powered False 15:59:45.994177 bus /gobi_1: Setting Powered False 15:59:47.092280 bus /gobi_1: Setting Powered False 15:59:48.205825 bus /gobi_0: Setting Powered False 15:59:49.303930 bus /gobi_0: Setting Powered False 15:59:50.424757 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200 ping.py ---------------------------------------------- 15:59:51.529328 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:51.540798 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 15:59:51.590619 tst ping.py: using LAC 22136 15:59:51.718671 tst ping.py: using RAC 206 15:59:51.844903 tst ping.py: using CellId 22136 15:59:51.976885 tst ping.py: using BVCI 22137 15:59:52.095482 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:52.106822 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:52.118012 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:52.129202 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:52.140280 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:52.151473 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:52.162939 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:52.174163 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:59:52.291833 tst ping.py:19: start network... 15:59:52.495927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:59:52.962897 run create_hlr_db(pid=20009): Launched 15:59:53.086667 bus /gobi_6: Setting Powered False 15:59:54.147643 run create_hlr_db(pid=20009): Terminated: ok {rc=0} 15:59:54.591863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20011): Launched 15:59:54.915420 run osmo-hlr_10.42.42.2(pid=20012): Launched 15:59:55.040259 run osmo-stp_10.42.42.5: Starting osmo-stp 15:59:55.599904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20014): Launched 15:59:55.923314 run osmo-stp_10.42.42.5(pid=20015): Launched 15:59:56.048179 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:59:56.605155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20017): Launched 15:59:56.729119 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:59:57.002346 run patchelf(pid=20018): Launched 15:59:57.183423 run osmo-stp_10.42.42.5(pid=20015): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20015)] 15:59:57.320205 run osmo-stp_10.42.42.5(pid=20015): stdout: | (launched: 2022-12-09_15:59:55.864070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:57.458890 run osmo-stp_10.42.42.5(pid=20015): stderr: | [0;m[38;5;43m20221209155956053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155956053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155956053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155956054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155956054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155956054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155956054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:57.594262 run osmo-stp_10.42.42.5(pid=20015): stdout: | (launched: 2022-12-09_15:59:55.864070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:59:57.718340 run osmo-stp_10.42.42.5(pid=20015): stderr: | [0;m[38;5;43m20221209155956053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209155956053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209155956053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209155956054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209155956054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209155956054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209155956054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:59:57.865598 run patchelf(pid=20018): Terminating (SIGINT) 15:59:58.034524 run patchelf(pid=20018): Terminated: ok {rc=0} 15:59:58.156747 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20015): Process ended prematurely: osmo-stp_10.42.42.5(pid=20015) [trial-2361↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20015)] [trial-2361↪gprs:trx-b200↪ping.py:22] 15:59:58.165885 tst ping.py:22: Test FAILED (6.6 sec) 15:59:58.193356 run osmo-hlr_10.42.42.2(pid=20012): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20012)] 15:59:58.241488 run osmo-hlr_10.42.42.2(pid=20012): stdout: | (launched: 2022-12-09_15:59:54.856225) 15:59:58.290920 run osmo-hlr_10.42.42.2(pid=20012): stderr: | [0;m[1;31m20221209155955052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209155955052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209155955052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209155955052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209155955053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209155955053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209155955065 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209155955074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209155955074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209155955074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:59:58.340634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20011): Terminating (SIGTERM) 15:59:58.380522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20014): Terminating (SIGTERM) 15:59:58.420334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20017): Terminating (SIGTERM) 15:59:58.460471 --- ParallelTerminationStrategy: PID 20011 died... 15:59:58.479755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20011): Terminated: ok {rc=0} 15:59:58.524037 --- ParallelTerminationStrategy: PID 20014 died... 15:59:58.542802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20014): Terminated: ok {rc=0} 15:59:58.586820 --- ParallelTerminationStrategy: PID 20017 died... 15:59:58.605993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20017): Terminated: ok {rc=0} 15:59:58.691191 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 15:59:59.780911 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:59:59.793216 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 15:59:59.846830 tst ping_idle_ping.py: using LAC 22137 15:59:59.974884 tst ping_idle_ping.py: using RAC 207 16:00:00.101260 tst ping_idle_ping.py: using CellId 22137 16:00:00.229597 tst ping_idle_ping.py: using BVCI 22138 16:00:00.348807 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:00.360070 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:00.371225 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:00.383087 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:00.394703 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:00.406460 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:00.418396 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:00:00.430237 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:00:00.548727 tst ping_idle_ping.py:24: start network... 16:00:00.754107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:00:01.300112 run create_hlr_db(pid=20022): Launched 16:00:01.459021 bus /gobi_6: Setting Powered False 16:00:02.519649 run create_hlr_db(pid=20022): Terminated: ok {rc=0} 16:00:02.943150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20024): Launched 16:00:03.245908 run osmo-hlr_10.42.42.2(pid=20025): Launched 16:00:03.361429 run osmo-stp_10.42.42.5: Starting osmo-stp 16:00:03.894193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20027): Launched 16:00:04.197443 run osmo-stp_10.42.42.5(pid=20028): Launched 16:00:04.312935 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:00:04.834352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20030): Launched 16:00:04.950932 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:00:05.207862 run patchelf(pid=20031): Launched 16:00:05.376697 run osmo-stp_10.42.42.5(pid=20028): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20028)] 16:00:05.504877 run osmo-stp_10.42.42.5(pid=20028): stdout: | (launched: 2022-12-09_16:00:04.141811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:05.634666 run osmo-stp_10.42.42.5(pid=20028): stderr: | [0;m[38;5;43m20221209160004311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160004311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160004311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160004312 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160004312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160004312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160004312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:05.764808 run osmo-stp_10.42.42.5(pid=20028): stdout: | (launched: 2022-12-09_16:00:04.141811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:05.889110 run osmo-stp_10.42.42.5(pid=20028): stderr: | [0;m[38;5;43m20221209160004311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160004311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160004311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160004312 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160004312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160004312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160004312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:06.036279 run patchelf(pid=20031): Terminating (SIGINT) 16:00:06.205642 run patchelf(pid=20031): Terminated: ok {rc=0} 16:00:06.328637 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20028): Process ended prematurely: osmo-stp_10.42.42.5(pid=20028) [trial-2361↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20028)] [trial-2361↪gprs:trx-b200↪ping_idle_ping.py:27] 16:00:06.337614 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:00:06.364672 run osmo-hlr_10.42.42.2(pid=20025): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20025)] 16:00:06.412540 run osmo-hlr_10.42.42.2(pid=20025): stdout: | (launched: 2022-12-09_16:00:03.190387) 16:00:06.462468 run osmo-hlr_10.42.42.2(pid=20025): stderr: | [0;m[1;31m20221209160003366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160003366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160003366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160003366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160003366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160003366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160003379 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160003388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160003388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160003388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:00:06.512722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20024): Terminating (SIGTERM) 16:00:06.552864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20027): Terminating (SIGTERM) 16:00:06.593122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20030): Terminating (SIGTERM) 16:00:06.633617 --- ParallelTerminationStrategy: PID 20024 died... 16:00:06.652777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20024): Terminated: ok {rc=0} 16:00:06.698468 --- ParallelTerminationStrategy: PID 20027 died... 16:00:06.717181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20027): Terminated: ok {rc=0} 16:00:06.761223 --- ParallelTerminationStrategy: PID 20030 died... 16:00:06.779766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20030): Terminated: ok {rc=0} 16:00:06.865771 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 16:00:08.182245 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:00:08.188899 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:00:08.222396 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:00:08.260667 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:00:08.348326 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:00:08.380993 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:00:08.418853 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:00:09.014063 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:00:09.063173 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:09.074069 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:00:09.125056 tst cs_paging_gprs_active.py: using LAC 22138 16:00:09.247223 tst cs_paging_gprs_active.py: using RAC 208 16:00:09.369595 tst cs_paging_gprs_active.py: using CellId 22138 16:00:09.491722 tst cs_paging_gprs_active.py: using BVCI 22139 16:00:09.607262 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:09.618316 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:09.628927 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:09.639636 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:09.650264 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:09.660815 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:09.671618 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:09.682227 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:09.692938 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:09.816096 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:09.936287 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:00:10.145349 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:10.457468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20037): Launched 16:00:10.727269 run iperf3-srv_10.42.42.10(pid=20038): Launched 16:00:10.844436 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:00:11.052572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:11.364294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20039): Launched 16:00:11.634442 run iperf3-srv_10.42.42.10(pid=20040): Launched 16:00:11.752883 tst cs_paging_gprs_active.py:38: start network... 16:00:11.960847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:00:12.439407 run create_hlr_db(pid=20041): Launched 16:00:12.566251 bus /gobi_6: Setting Powered False 16:00:13.627660 run create_hlr_db(pid=20041): Terminated: ok {rc=0} 16:00:14.078457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20043): Launched 16:00:14.410344 run osmo-hlr_10.42.42.2(pid=20044): Launched 16:00:14.536642 run osmo-stp_10.42.42.5: Starting osmo-stp 16:00:15.107350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20046): Launched 16:00:15.437175 run osmo-stp_10.42.42.5(pid=20047): Launched 16:00:15.564388 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:00:16.173316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20049): Launched 16:00:16.317221 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:00:16.602801 run patchelf(pid=20050): Launched 16:00:16.803056 run osmo-stp_10.42.42.5(pid=20047): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20047)] 16:00:16.947284 run osmo-stp_10.42.42.5(pid=20047): stdout: | (launched: 2022-12-09_16:00:15.377297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:17.092579 run osmo-stp_10.42.42.5(pid=20047): stderr: | [0;m[38;5;43m20221209160015566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160015566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160015566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160015567 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160015567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160015567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160015568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:17.237703 run osmo-stp_10.42.42.5(pid=20047): stdout: | (launched: 2022-12-09_16:00:15.377297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:17.373151 run osmo-stp_10.42.42.5(pid=20047): stderr: | [0;m[38;5;43m20221209160015566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160015566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160015566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160015567 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160015567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160015567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160015568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:17.533205 run patchelf(pid=20050): Terminating (SIGINT) 16:00:17.718808 run patchelf(pid=20050): Terminated: ok {rc=0} 16:00:17.852588 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20047): Process ended prematurely: osmo-stp_10.42.42.5(pid=20047) [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20047)] [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:00:17.863344 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 16:00:17.892405 run osmo-hlr_10.42.42.2(pid=20044): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20044)] 16:00:17.942615 run osmo-hlr_10.42.42.2(pid=20044): stdout: | (launched: 2022-12-09_16:00:14.349802) 16:00:17.994634 run osmo-hlr_10.42.42.2(pid=20044): stderr: | [0;m[1;31m20221209160014548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160014548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160014548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160014548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160014548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160014548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160014560 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160014568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160014569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160014569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:00:18.046914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20037): Terminating (SIGTERM) 16:00:18.088922 run iperf3-srv_10.42.42.10(pid=20038): Terminating (SIGTERM) 16:00:18.130896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20039): Terminating (SIGTERM) 16:00:18.172848 run iperf3-srv_10.42.42.10(pid=20040): Terminating (SIGTERM) 16:00:18.214854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20043): Terminating (SIGTERM) 16:00:18.256733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20046): Terminating (SIGTERM) 16:00:18.298647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20049): Terminating (SIGTERM) 16:00:18.341018 --- ParallelTerminationStrategy: PID 20037 died... 16:00:18.360533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20037): Terminated: ok {rc=0} 16:00:18.406888 --- ParallelTerminationStrategy: PID 20038 died... 16:00:18.426161 run iperf3-srv_10.42.42.10(pid=20038): Terminated {rc=256} 16:00:18.472231 --- ParallelTerminationStrategy: PID 20039 died... 16:00:18.491733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20039): Terminated: ok {rc=0} 16:00:18.538393 --- ParallelTerminationStrategy: PID 20040 died... 16:00:18.558178 run iperf3-srv_10.42.42.10(pid=20040): Terminated {rc=256} 16:00:18.604348 --- ParallelTerminationStrategy: PID 20043 died... 16:00:18.623746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20043): Terminated: ok {rc=0} 16:00:18.670193 --- ParallelTerminationStrategy: PID 20046 died... 16:00:18.689655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20046): Terminated: ok {rc=0} 16:00:18.735856 --- ParallelTerminationStrategy: PID 20049 died... 16:00:18.755312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20049): Terminated: ok {rc=0} 16:00:18.843577 bus /gobi_0: Setting Powered False 16:00:19.942596 bus /gobi_0: Setting Powered False 16:00:21.058177 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:00:22.208756 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:22.221221 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:00:22.277426 tst iperf3.py: using LAC 22139 16:00:22.411813 tst iperf3.py: using RAC 209 16:00:22.540101 tst iperf3.py: using CellId 22139 16:00:22.668451 tst iperf3.py: using BVCI 22140 16:00:22.787725 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:22.799179 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:22.810358 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:22.821835 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:22.833096 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:22.844349 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:22.855939 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:22.867561 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:22.879210 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:22.999023 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:00:23.222085 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:23.551753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20051): Launched 16:00:23.839016 run iperf3-srv_10.42.42.10(pid=20052): Launched 16:00:23.963386 tst iperf3.py:8: start network... 16:00:24.186611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:00:24.695443 run create_hlr_db(pid=20053): Launched 16:00:24.820232 bus /gobi_6: Setting Powered False 16:00:25.885751 run create_hlr_db(pid=20053): Terminated: ok {rc=0} 16:00:26.326354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20055): Launched 16:00:26.636825 run osmo-hlr_10.42.42.2(pid=20056): Launched 16:00:26.756019 run osmo-stp_10.42.42.5: Starting osmo-stp 16:00:27.297817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20058): Launched 16:00:27.605476 run osmo-stp_10.42.42.5(pid=20059): Launched 16:00:27.724341 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:00:28.253106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20061): Launched 16:00:28.371420 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:00:28.632024 run patchelf(pid=20062): Launched 16:00:28.803885 run osmo-stp_10.42.42.5(pid=20059): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20059)] 16:00:28.934177 run osmo-stp_10.42.42.5(pid=20059): stdout: | (launched: 2022-12-09_16:00:27.548424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:29.066393 run osmo-stp_10.42.42.5(pid=20059): stderr: | [0;m[38;5;43m20221209160027719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160027719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160027719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160027720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160027720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160027720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160027720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:29.198561 run osmo-stp_10.42.42.5(pid=20059): stdout: | (launched: 2022-12-09_16:00:27.548424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:29.324220 run osmo-stp_10.42.42.5(pid=20059): stderr: | [0;m[38;5;43m20221209160027719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160027719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160027719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160027720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160027720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160027720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160027720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:29.473423 run patchelf(pid=20062): Terminating (SIGINT) 16:00:29.645489 run patchelf(pid=20062): Terminated: ok {rc=0} 16:00:29.769840 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20059): Process ended prematurely: osmo-stp_10.42.42.5(pid=20059) [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20059)] [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 16:00:29.779314 tst iperf3.py:8: Test FAILED (7.6 sec) 16:00:29.806482 run osmo-hlr_10.42.42.2(pid=20056): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20056)] 16:00:29.853905 run osmo-hlr_10.42.42.2(pid=20056): stdout: | (launched: 2022-12-09_16:00:26.579825) 16:00:29.903161 run osmo-hlr_10.42.42.2(pid=20056): stderr: | [0;m[1;31m20221209160026757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160026757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160026757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160026757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160026757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160026757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160026769 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160026777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160026778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160026778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:00:29.952855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20051): Terminating (SIGTERM) 16:00:29.992615 run iperf3-srv_10.42.42.10(pid=20052): Terminating (SIGTERM) 16:00:30.032728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20055): Terminating (SIGTERM) 16:00:30.072251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20058): Terminating (SIGTERM) 16:00:30.112077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20061): Terminating (SIGTERM) 16:00:30.151882 --- ParallelTerminationStrategy: PID 20051 died... 16:00:30.170980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20051): Terminated: ok {rc=0} 16:00:30.215149 --- ParallelTerminationStrategy: PID 20052 died... 16:00:30.233944 run iperf3-srv_10.42.42.10(pid=20052): Terminated {rc=256} 16:00:30.278052 --- ParallelTerminationStrategy: PID 20055 died... 16:00:30.296671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20055): Terminated: ok {rc=0} 16:00:30.341252 --- ParallelTerminationStrategy: PID 20058 died... 16:00:30.359772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20058): Terminated: ok {rc=0} 16:00:30.403806 --- ParallelTerminationStrategy: PID 20061 died... 16:00:30.422521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20061): Terminated: ok {rc=0} 16:00:30.507645 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:00:31.657336 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:31.669905 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:00:31.724658 tst iperf3m4.py: using LAC 22140 16:00:31.851791 tst iperf3m4.py: using RAC 210 16:00:32.022122 tst iperf3m4.py: using CellId 22140 16:00:32.155894 tst iperf3m4.py: using BVCI 22141 16:00:32.278891 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:32.290985 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:32.303120 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:32.315949 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:32.327421 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:32.338780 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:32.349918 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:32.360516 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:32.371458 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:32.493382 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:32.619043 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:32.741835 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:32.864311 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:00:33.087799 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:33.418631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20063): Launched 16:00:33.707312 run iperf3-srv_10.42.42.10(pid=20064): Launched 16:00:33.831357 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:00:34.055133 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:34.387087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20065): Launched 16:00:34.675053 run iperf3-srv_10.42.42.10(pid=20066): Launched 16:00:34.798640 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:00:35.021506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:35.353391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20067): Launched 16:00:35.640103 run iperf3-srv_10.42.42.10(pid=20068): Launched 16:00:35.763652 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:00:35.987113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:00:36.318107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20069): Launched 16:00:36.606752 run iperf3-srv_10.42.42.10(pid=20070): Launched 16:00:36.730262 tst iperf3m4.py:8: start network... 16:00:36.953855 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:00:37.463875 run create_hlr_db(pid=20071): Launched 16:00:37.591464 bus /gobi_6: Setting Powered False 16:00:38.655669 run create_hlr_db(pid=20071): Terminated: ok {rc=0} 16:00:39.115437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20073): Launched 16:00:39.447587 run osmo-hlr_10.42.42.2(pid=20074): Launched 16:00:39.573740 run osmo-stp_10.42.42.5: Starting osmo-stp 16:00:40.141576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20076): Launched 16:00:40.472845 run osmo-stp_10.42.42.5(pid=20077): Launched 16:00:40.599905 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:00:41.168745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20079): Launched 16:00:41.296872 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:00:41.575309 run patchelf(pid=20080): Launched 16:00:41.760400 run osmo-stp_10.42.42.5(pid=20077): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20077)] 16:00:41.901189 run osmo-stp_10.42.42.5(pid=20077): stdout: | (launched: 2022-12-09_16:00:40.412690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:42.042950 run osmo-stp_10.42.42.5(pid=20077): stderr: | [0;m[38;5;43m20221209160040600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160040601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160040601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160040601 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160040602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160040602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160040602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:42.184623 run osmo-stp_10.42.42.5(pid=20077): stdout: | (launched: 2022-12-09_16:00:40.412690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:42.319550 run osmo-stp_10.42.42.5(pid=20077): stderr: | [0;m[38;5;43m20221209160040600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160040601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160040601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160040601 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160040602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160040602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160040602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:42.479910 run patchelf(pid=20080): Terminating (SIGINT) 16:00:42.665305 run patchelf(pid=20080): Terminated: ok {rc=0} 16:00:42.798704 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20077): Process ended prematurely: osmo-stp_10.42.42.5(pid=20077) [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20077)] [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 16:00:42.808711 tst iperf3m4.py:8: Test FAILED (11.2 sec) 16:00:42.838132 run osmo-hlr_10.42.42.2(pid=20074): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20074)] 16:00:42.888722 run osmo-hlr_10.42.42.2(pid=20074): stdout: | (launched: 2022-12-09_16:00:39.387288) 16:00:42.941091 run osmo-hlr_10.42.42.2(pid=20074): stderr: | [0;m[1;31m20221209160039584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160039584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160039584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160039584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160039584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160039584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160039597 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160039606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160039606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160039606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:00:42.993429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20063): Terminating (SIGTERM) 16:00:43.035467 run iperf3-srv_10.42.42.10(pid=20064): Terminating (SIGTERM) 16:00:43.077437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20065): Terminating (SIGTERM) 16:00:43.119877 run iperf3-srv_10.42.42.10(pid=20066): Terminating (SIGTERM) 16:00:43.162086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20067): Terminating (SIGTERM) 16:00:43.204350 run iperf3-srv_10.42.42.10(pid=20068): Terminating (SIGTERM) 16:00:43.246511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20069): Terminating (SIGTERM) 16:00:43.288639 run iperf3-srv_10.42.42.10(pid=20070): Terminating (SIGTERM) 16:00:43.330711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20073): Terminating (SIGTERM) 16:00:43.372722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20076): Terminating (SIGTERM) 16:00:43.414619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20079): Terminating (SIGTERM) 16:00:43.456743 --- ParallelTerminationStrategy: PID 20063 died... 16:00:43.476909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20063): Terminated: ok {rc=0} 16:00:43.523714 --- ParallelTerminationStrategy: PID 20064 died... 16:00:43.543366 run iperf3-srv_10.42.42.10(pid=20064): Terminated {rc=256} 16:00:43.589850 --- ParallelTerminationStrategy: PID 20065 died... 16:00:43.609363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20065): Terminated: ok {rc=0} 16:00:43.655832 --- ParallelTerminationStrategy: PID 20066 died... 16:00:43.675418 run iperf3-srv_10.42.42.10(pid=20066): Terminated {rc=256} 16:00:43.721780 --- ParallelTerminationStrategy: PID 20067 died... 16:00:43.741366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20067): Terminated: ok {rc=0} 16:00:43.787807 --- ParallelTerminationStrategy: PID 20068 died... 16:00:43.807401 run iperf3-srv_10.42.42.10(pid=20068): Terminated {rc=256} 16:00:43.853914 --- ParallelTerminationStrategy: PID 20069 died... 16:00:43.873840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20069): Terminated: ok {rc=0} 16:00:43.920439 --- ParallelTerminationStrategy: PID 20070 died... 16:00:43.940106 run iperf3-srv_10.42.42.10(pid=20070): Terminated {rc=256} 16:00:43.986638 --- ParallelTerminationStrategy: PID 20073 died... 16:00:44.006321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20073): Terminated: ok {rc=0} 16:00:44.052813 --- ParallelTerminationStrategy: PID 20076 died... 16:00:44.072905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20076): Terminated: ok {rc=0} 16:00:44.119711 --- ParallelTerminationStrategy: PID 20079 died... 16:00:44.139413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20079): Terminated: ok {rc=0} 16:00:44.228121 bus /gobi_4: Setting Powered False 16:00:45.326822 bus /gobi_4: Setting Powered False 16:00:46.443029 bus /gobi_1: Setting Powered False 16:00:47.540032 bus /gobi_1: Setting Powered False 16:00:48.655235 bus /gobi_0: Setting Powered False 16:00:49.755242 bus /gobi_0: Setting Powered False 16:00:50.873057 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 16:00:51.977308 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:51.989576 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:00:52.043470 tst ping.py: using LAC 22141 16:00:52.172615 tst ping.py: using RAC 211 16:00:52.292834 tst ping.py: using CellId 22141 16:00:52.412716 tst ping.py: using BVCI 22142 16:00:52.522196 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:52.533139 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:52.543804 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:52.554521 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:52.565122 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:52.575648 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:52.586591 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:00:52.597230 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:00:52.717436 tst ping.py:19: start network... 16:00:52.938015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:00:53.439115 run create_hlr_db(pid=20081): Launched 16:00:53.563788 bus /gobi_6: Setting Powered False 16:00:54.627524 run create_hlr_db(pid=20081): Terminated: ok {rc=0} 16:00:55.061462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20083): Launched 16:00:55.364459 run osmo-hlr_10.42.42.2(pid=20084): Launched 16:00:55.479547 run osmo-stp_10.42.42.5: Starting osmo-stp 16:00:56.007925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20086): Launched 16:00:56.310975 run osmo-stp_10.42.42.5(pid=20087): Launched 16:00:56.428851 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:00:56.952843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20089): Launched 16:00:57.068390 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:00:57.324578 run patchelf(pid=20090): Launched 16:00:57.492772 run osmo-stp_10.42.42.5(pid=20087): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20087)] 16:00:57.620691 run osmo-stp_10.42.42.5(pid=20087): stdout: | (launched: 2022-12-09_16:00:56.255124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:57.750383 run osmo-stp_10.42.42.5(pid=20087): stderr: | [0;m[38;5;43m20221209160056422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160056423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160056423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160056423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160056424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160056424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160056424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:57.880683 run osmo-stp_10.42.42.5(pid=20087): stdout: | (launched: 2022-12-09_16:00:56.255124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:00:58.004535 run osmo-stp_10.42.42.5(pid=20087): stderr: | [0;m[38;5;43m20221209160056422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160056423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160056423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160056423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160056424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160056424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160056424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:00:58.151788 run patchelf(pid=20090): Terminating (SIGINT) 16:00:58.319978 run patchelf(pid=20090): Terminated: ok {rc=0} 16:00:58.441332 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20087): Process ended prematurely: osmo-stp_10.42.42.5(pid=20087) [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20087)] [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 16:00:58.450170 tst ping.py:22: Test FAILED (6.5 sec) 16:00:58.476744 run osmo-hlr_10.42.42.2(pid=20084): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20084)] 16:00:58.524784 run osmo-hlr_10.42.42.2(pid=20084): stdout: | (launched: 2022-12-09_16:00:55.308706) 16:00:58.574453 run osmo-hlr_10.42.42.2(pid=20084): stderr: | [0;m[1;31m20221209160055484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160055484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160055484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160055484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160055484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160055484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160055496 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160055505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160055506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160055506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:00:58.624362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20083): Terminating (SIGTERM) 16:00:58.664298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20086): Terminating (SIGTERM) 16:00:58.704649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20089): Terminating (SIGTERM) 16:00:58.745077 --- ParallelTerminationStrategy: PID 20083 died... 16:00:58.764380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20083): Terminated: ok {rc=0} 16:00:58.808618 --- ParallelTerminationStrategy: PID 20086 died... 16:00:58.827532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20086): Terminated: ok {rc=0} 16:00:58.871547 --- ParallelTerminationStrategy: PID 20089 died... 16:00:58.890379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20089): Terminated: ok {rc=0} 16:00:58.976176 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:01:00.065313 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:00.077640 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:01:00.129660 tst ping_idle_ping.py: using LAC 22142 16:01:00.249199 tst ping_idle_ping.py: using RAC 212 16:01:00.367549 tst ping_idle_ping.py: using CellId 22142 16:01:00.486047 tst ping_idle_ping.py: using BVCI 22143 16:01:00.604238 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:00.616228 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:00.627662 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:00.639127 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:00.650854 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:00.662427 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:00.674800 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:01:00.686434 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:01:00.805398 tst ping_idle_ping.py:24: start network... 16:01:01.047481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:01:01.569826 run create_hlr_db(pid=20091): Launched 16:01:01.730351 bus /gobi_6: Setting Powered False 16:01:02.794712 run create_hlr_db(pid=20091): Terminated: ok {rc=0} 16:01:03.234961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20093): Launched 16:01:03.539545 run osmo-hlr_10.42.42.2(pid=20094): Launched 16:01:03.655385 run osmo-stp_10.42.42.5: Starting osmo-stp 16:01:04.188931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20096): Launched 16:01:04.492114 run osmo-stp_10.42.42.5(pid=20097): Launched 16:01:04.607606 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:01:05.132428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20099): Launched 16:01:05.249353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:01:05.506437 run patchelf(pid=20100): Launched 16:01:05.677784 run osmo-stp_10.42.42.5(pid=20097): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20097)] 16:01:05.806609 run osmo-stp_10.42.42.5(pid=20097): stdout: | (launched: 2022-12-09_16:01:04.436242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:05.948670 run osmo-stp_10.42.42.5(pid=20097): stderr: | [0;m[38;5;43m20221209160104604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160104605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160104605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160104605 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160104606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160104606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160104606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:06.088515 run osmo-stp_10.42.42.5(pid=20097): stdout: | (launched: 2022-12-09_16:01:04.436242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:06.222717 run osmo-stp_10.42.42.5(pid=20097): stderr: | [0;m[38;5;43m20221209160104604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160104605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160104605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160104605 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160104606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160104606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160104606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:06.381540 run patchelf(pid=20100): Terminating (SIGINT) 16:01:06.564023 run patchelf(pid=20100): Terminated: ok {rc=0} 16:01:06.696051 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20097): Process ended prematurely: osmo-stp_10.42.42.5(pid=20097) [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20097)] [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 16:01:06.706014 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:01:06.735253 run osmo-hlr_10.42.42.2(pid=20094): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20094)] 16:01:06.786495 run osmo-hlr_10.42.42.2(pid=20094): stdout: | (launched: 2022-12-09_16:01:03.483302) 16:01:06.839113 run osmo-hlr_10.42.42.2(pid=20094): stderr: | [0;m[1;31m20221209160103658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160103658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160103658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160103658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160103658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160103658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160103670 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160103679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160103680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160103680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:01:06.892589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20093): Terminating (SIGTERM) 16:01:06.935447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20096): Terminating (SIGTERM) 16:01:06.978099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20099): Terminating (SIGTERM) 16:01:07.020903 --- ParallelTerminationStrategy: PID 20093 died... 16:01:07.041380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20093): Terminated: ok {rc=0} 16:01:07.088924 --- ParallelTerminationStrategy: PID 20096 died... 16:01:07.108760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20096): Terminated: ok {rc=0} 16:01:07.155823 --- ParallelTerminationStrategy: PID 20099 died... 16:01:07.175622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20099): Terminated: ok {rc=0} 16:01:07.264841 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:01:08.577296 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:01:08.584675 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:01:08.620144 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:01:08.660130 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:01:08.749859 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:01:08.784295 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:01:08.824307 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:01:09.425371 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:01:09.478827 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:09.490333 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:01:09.560778 tst cs_paging_gprs_active.py: using LAC 22143 16:01:09.686964 tst cs_paging_gprs_active.py: using RAC 213 16:01:09.816297 tst cs_paging_gprs_active.py: using CellId 22143 16:01:09.945203 tst cs_paging_gprs_active.py: using BVCI 22144 16:01:10.065115 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:10.076578 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:10.087918 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:10.099542 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:10.110944 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:10.122563 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:10.134173 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:10.145661 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:10.157268 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:10.279248 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:10.397249 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:01:10.605506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:10.916852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20105): Launched 16:01:11.187959 run iperf3-srv_10.42.42.10(pid=20106): Launched 16:01:11.304502 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:01:11.511573 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:11.822186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20107): Launched 16:01:12.094313 run iperf3-srv_10.42.42.10(pid=20108): Launched 16:01:12.211729 tst cs_paging_gprs_active.py:38: start network... 16:01:12.418819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:01:12.898442 run create_hlr_db(pid=20109): Launched 16:01:13.026592 bus /gobi_6: Setting Powered False 16:01:14.087830 run create_hlr_db(pid=20109): Terminated: ok {rc=0} 16:01:14.538318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20111): Launched 16:01:14.870805 run osmo-hlr_10.42.42.2(pid=20112): Launched 16:01:14.997607 run osmo-stp_10.42.42.5: Starting osmo-stp 16:01:15.565424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20114): Launched 16:01:15.912347 run osmo-stp_10.42.42.5(pid=20115): Launched 16:01:16.151637 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:01:16.789425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20117): Launched 16:01:16.922225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:01:17.194928 run patchelf(pid=20118): Launched 16:01:17.373240 run osmo-stp_10.42.42.5(pid=20115): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20115)] 16:01:17.503970 run osmo-stp_10.42.42.5(pid=20115): stdout: | (launched: 2022-12-09_16:01:15.840890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:17.637201 run osmo-stp_10.42.42.5(pid=20115): stderr: | [0;m[38;5;43m20221209160116126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160116126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160116126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160116126 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160116127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160116127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160116127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:17.769868 run osmo-stp_10.42.42.5(pid=20115): stdout: | (launched: 2022-12-09_16:01:15.840890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:17.895960 run osmo-stp_10.42.42.5(pid=20115): stderr: | [0;m[38;5;43m20221209160116126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160116126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160116126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160116126 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160116127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160116127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160116127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:18.045363 run patchelf(pid=20118): Terminating (SIGINT) 16:01:18.219828 run patchelf(pid=20118): Terminated: ok {rc=0} 16:01:18.345685 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20115): Process ended prematurely: osmo-stp_10.42.42.5(pid=20115) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20115)] [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:01:18.355213 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 16:01:18.382631 run osmo-hlr_10.42.42.2(pid=20112): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20112)] 16:01:18.430750 run osmo-hlr_10.42.42.2(pid=20112): stdout: | (launched: 2022-12-09_16:01:14.810883) 16:01:18.480357 run osmo-hlr_10.42.42.2(pid=20112): stderr: | [0;m[1;31m20221209160115008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160115008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160115008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160115008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160115009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160115009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160115021 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160115032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160115032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160115032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:01:18.530280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20105): Terminating (SIGTERM) 16:01:18.570517 run iperf3-srv_10.42.42.10(pid=20106): Terminating (SIGTERM) 16:01:18.610576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20107): Terminating (SIGTERM) 16:01:18.650522 run iperf3-srv_10.42.42.10(pid=20108): Terminating (SIGTERM) 16:01:18.690403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20111): Terminating (SIGTERM) 16:01:18.730452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20114): Terminating (SIGTERM) 16:01:18.770376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20117): Terminating (SIGTERM) 16:01:18.810561 --- ParallelTerminationStrategy: PID 20105 died... 16:01:18.830143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20105): Terminated: ok {rc=0} 16:01:18.874735 --- ParallelTerminationStrategy: PID 20106 died... 16:01:18.893419 run iperf3-srv_10.42.42.10(pid=20106): Terminated {rc=256} 16:01:18.937300 --- ParallelTerminationStrategy: PID 20107 died... 16:01:18.956041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20107): Terminated: ok {rc=0} 16:01:18.999900 --- ParallelTerminationStrategy: PID 20108 died... 16:01:19.018518 run iperf3-srv_10.42.42.10(pid=20108): Terminated {rc=256} 16:01:19.062947 --- ParallelTerminationStrategy: PID 20111 died... 16:01:19.081637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20111): Terminated: ok {rc=0} 16:01:19.125756 --- ParallelTerminationStrategy: PID 20114 died... 16:01:19.144406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20114): Terminated: ok {rc=0} 16:01:19.188627 --- ParallelTerminationStrategy: PID 20117 died... 16:01:19.207468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20117): Terminated: ok {rc=0} 16:01:19.291847 bus /gobi_0: Setting Powered False 16:01:20.389727 bus /gobi_0: Setting Powered False 16:01:21.505264 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:01:22.653297 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:22.665134 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:01:22.742954 tst iperf3.py: using LAC 22144 16:01:22.869653 tst iperf3.py: using RAC 214 16:01:22.996363 tst iperf3.py: using CellId 22144 16:01:23.122077 tst iperf3.py: using BVCI 22145 16:01:23.241366 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:23.253010 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:23.264441 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:23.276034 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:23.287375 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:23.298772 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:23.310386 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:23.321783 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:23.333441 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:23.452107 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:01:23.659982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:23.968581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20119): Launched 16:01:24.237652 run iperf3-srv_10.42.42.10(pid=20120): Launched 16:01:24.353109 tst iperf3.py:8: start network... 16:01:24.559255 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:01:25.034554 run create_hlr_db(pid=20121): Launched 16:01:25.160581 bus /gobi_6: Setting Powered False 16:01:26.221664 run create_hlr_db(pid=20121): Terminated: ok {rc=0} 16:01:26.671126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20123): Launched 16:01:27.003139 run osmo-hlr_10.42.42.2(pid=20124): Launched 16:01:27.130150 run osmo-stp_10.42.42.5: Starting osmo-stp 16:01:27.696517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20126): Launched 16:01:28.026603 run osmo-stp_10.42.42.5(pid=20127): Launched 16:01:28.151589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:01:28.718554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20129): Launched 16:01:28.846782 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:01:29.126080 run patchelf(pid=20130): Launched 16:01:29.311197 run osmo-stp_10.42.42.5(pid=20127): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20127)] 16:01:29.451322 run osmo-stp_10.42.42.5(pid=20127): stdout: | (launched: 2022-12-09_16:01:27.966430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:29.592595 run osmo-stp_10.42.42.5(pid=20127): stderr: | [0;m[38;5;43m20221209160128158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160128158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160128158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160128159 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160128159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160128159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160128159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:29.734157 run osmo-stp_10.42.42.5(pid=20127): stdout: | (launched: 2022-12-09_16:01:27.966430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:29.868923 run osmo-stp_10.42.42.5(pid=20127): stderr: | [0;m[38;5;43m20221209160128158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160128158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160128158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160128159 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160128159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160128159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160128159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:30.029540 run patchelf(pid=20130): Terminating (SIGINT) 16:01:30.214285 run patchelf(pid=20130): Terminated: ok {rc=0} 16:01:30.347867 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20127): Process ended prematurely: osmo-stp_10.42.42.5(pid=20127) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20127)] [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 16:01:30.357978 tst iperf3.py:8: Test FAILED (7.7 sec) 16:01:30.387061 run osmo-hlr_10.42.42.2(pid=20124): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20124)] 16:01:30.437495 run osmo-hlr_10.42.42.2(pid=20124): stdout: | (launched: 2022-12-09_16:01:26.943588) 16:01:30.489713 run osmo-hlr_10.42.42.2(pid=20124): stderr: | [0;m[1;31m20221209160127140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160127140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160127140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160127140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160127140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160127140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160127152 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160127160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160127160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160127160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:01:30.542185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20119): Terminating (SIGTERM) 16:01:30.584520 run iperf3-srv_10.42.42.10(pid=20120): Terminating (SIGTERM) 16:01:30.626946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20123): Terminating (SIGTERM) 16:01:30.669223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20126): Terminating (SIGTERM) 16:01:30.711488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20129): Terminating (SIGTERM) 16:01:30.754440 --- ParallelTerminationStrategy: PID 20119 died... 16:01:30.774568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20119): Terminated: ok {rc=0} 16:01:30.821608 --- ParallelTerminationStrategy: PID 20120 died... 16:01:30.846572 run iperf3-srv_10.42.42.10(pid=20120): Terminated {rc=256} 16:01:30.895117 --- ParallelTerminationStrategy: PID 20123 died... 16:01:30.931393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20123): Terminated: ok {rc=0} 16:01:30.981549 --- ParallelTerminationStrategy: PID 20126 died... 16:01:31.002081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20126): Terminated: ok {rc=0} 16:01:31.051154 --- ParallelTerminationStrategy: PID 20129 died... 16:01:31.071072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20129): Terminated: ok {rc=0} 16:01:31.163770 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:01:32.317687 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:32.330266 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:01:32.406566 tst iperf3m4.py: using LAC 22145 16:01:32.534171 tst iperf3m4.py: using RAC 215 16:01:32.660496 tst iperf3m4.py: using CellId 22145 16:01:32.786688 tst iperf3m4.py: using BVCI 22146 16:01:32.907787 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:32.919542 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:32.931105 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:32.942894 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:32.954770 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:32.966581 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:32.978419 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:32.990503 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:33.002469 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:33.123651 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:33.246560 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:33.367855 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:33.487907 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:01:33.697304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:34.008535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20131): Launched 16:01:34.278893 run iperf3-srv_10.42.42.10(pid=20132): Launched 16:01:34.395091 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:01:34.603334 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:34.914144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20133): Launched 16:01:35.185359 run iperf3-srv_10.42.42.10(pid=20134): Launched 16:01:35.301217 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:01:35.507657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:35.816623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20135): Launched 16:01:36.086481 run iperf3-srv_10.42.42.10(pid=20136): Launched 16:01:36.204857 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:01:36.412741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:01:36.724362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20137): Launched 16:01:36.995559 run iperf3-srv_10.42.42.10(pid=20138): Launched 16:01:37.111729 tst iperf3m4.py:8: start network... 16:01:37.319284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:01:37.797576 run create_hlr_db(pid=20139): Launched 16:01:37.924435 bus /gobi_6: Setting Powered False 16:01:38.986276 run create_hlr_db(pid=20139): Terminated: ok {rc=0} 16:01:39.438002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20141): Launched 16:01:39.769662 run osmo-hlr_10.42.42.2(pid=20142): Launched 16:01:39.897715 run osmo-stp_10.42.42.5: Starting osmo-stp 16:01:40.470098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20144): Launched 16:01:40.802087 run osmo-stp_10.42.42.5(pid=20145): Launched 16:01:40.929832 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:01:41.499336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20147): Launched 16:01:41.628622 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:01:41.908723 run patchelf(pid=20148): Launched 16:01:42.093600 run osmo-stp_10.42.42.5(pid=20145): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20145)] 16:01:42.233896 run osmo-stp_10.42.42.5(pid=20145): stdout: | (launched: 2022-12-09_16:01:40.741864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:42.375991 run osmo-stp_10.42.42.5(pid=20145): stderr: | [0;m[38;5;43m20221209160140931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160140931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160140931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160140932 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160140932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160140932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160140932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:42.517743 run osmo-stp_10.42.42.5(pid=20145): stdout: | (launched: 2022-12-09_16:01:40.741864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:42.652662 run osmo-stp_10.42.42.5(pid=20145): stderr: | [0;m[38;5;43m20221209160140931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160140931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160140931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160140932 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160140932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160140932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160140932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:42.812801 run patchelf(pid=20148): Terminating (SIGINT) 16:01:42.998945 run patchelf(pid=20148): Terminated: ok {rc=0} 16:01:43.133701 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20145): Process ended prematurely: osmo-stp_10.42.42.5(pid=20145) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20145)] [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:01:43.143896 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:01:43.173828 run osmo-hlr_10.42.42.2(pid=20142): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20142)] 16:01:43.224769 run osmo-hlr_10.42.42.2(pid=20142): stdout: | (launched: 2022-12-09_16:01:39.709651) 16:01:43.277277 run osmo-hlr_10.42.42.2(pid=20142): stderr: | [0;m[1;31m20221209160139904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160139904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160139904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160139904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160139904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160139904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160139916 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160139925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160139925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160139925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:01:43.329907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20131): Terminating (SIGTERM) 16:01:43.372198 run iperf3-srv_10.42.42.10(pid=20132): Terminating (SIGTERM) 16:01:43.414723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20133): Terminating (SIGTERM) 16:01:43.457748 run iperf3-srv_10.42.42.10(pid=20134): Terminating (SIGTERM) 16:01:43.500184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20135): Terminating (SIGTERM) 16:01:43.542790 run iperf3-srv_10.42.42.10(pid=20136): Terminating (SIGTERM) 16:01:43.584917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20137): Terminating (SIGTERM) 16:01:43.627368 run iperf3-srv_10.42.42.10(pid=20138): Terminating (SIGTERM) 16:01:43.669723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20141): Terminating (SIGTERM) 16:01:43.711939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20144): Terminating (SIGTERM) 16:01:43.754283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20147): Terminating (SIGTERM) 16:01:43.797072 --- ParallelTerminationStrategy: PID 20131 died... 16:01:43.817288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20131): Terminated: ok {rc=0} 16:01:43.864816 --- ParallelTerminationStrategy: PID 20132 died... 16:01:43.884495 run iperf3-srv_10.42.42.10(pid=20132): Terminated {rc=256} 16:01:43.931980 --- ParallelTerminationStrategy: PID 20133 died... 16:01:43.951874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20133): Terminated: ok {rc=0} 16:01:43.999124 --- ParallelTerminationStrategy: PID 20134 died... 16:01:44.018922 run iperf3-srv_10.42.42.10(pid=20134): Terminated {rc=256} 16:01:44.065961 --- ParallelTerminationStrategy: PID 20135 died... 16:01:44.085870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20135): Terminated: ok {rc=0} 16:01:44.132666 --- ParallelTerminationStrategy: PID 20136 died... 16:01:44.152410 run iperf3-srv_10.42.42.10(pid=20136): Terminated {rc=256} 16:01:44.199235 --- ParallelTerminationStrategy: PID 20137 died... 16:01:44.218997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20137): Terminated: ok {rc=0} 16:01:44.266279 --- ParallelTerminationStrategy: PID 20138 died... 16:01:44.286094 run iperf3-srv_10.42.42.10(pid=20138): Terminated {rc=256} 16:01:44.333249 --- ParallelTerminationStrategy: PID 20141 died... 16:01:44.352802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20141): Terminated: ok {rc=0} 16:01:44.400009 --- ParallelTerminationStrategy: PID 20144 died... 16:01:44.419812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20144): Terminated: ok {rc=0} 16:01:44.467095 --- ParallelTerminationStrategy: PID 20147 died... 16:01:44.487015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20147): Terminated: ok {rc=0} 16:01:44.576172 bus /gobi_4: Setting Powered False 16:01:45.677627 bus /gobi_4: Setting Powered False 16:01:46.802159 bus /gobi_1: Setting Powered False 16:01:47.904732 bus /gobi_1: Setting Powered False 16:01:49.023559 bus /gobi_0: Setting Powered False 16:01:50.123672 bus /gobi_0: Setting Powered False 16:01:51.240283 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:01:52.345377 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:52.357246 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:01:52.428358 tst ping.py: using LAC 22146 16:01:52.547851 tst ping.py: using RAC 216 16:01:52.667467 tst ping.py: using CellId 22146 16:01:52.785173 tst ping.py: using BVCI 22147 16:01:52.893719 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:52.904753 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:52.915678 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:52.926642 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:52.937783 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:52.948482 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:52.959379 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:01:52.970194 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:01:53.089433 tst ping.py:19: start network... 16:01:53.309196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:01:53.809156 run create_hlr_db(pid=20149): Launched 16:01:53.934063 bus /gobi_6: Setting Powered False 16:01:54.997959 run create_hlr_db(pid=20149): Terminated: ok {rc=0} 16:01:55.432566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20151): Launched 16:01:55.735723 run osmo-hlr_10.42.42.2(pid=20152): Launched 16:01:55.850669 run osmo-stp_10.42.42.5: Starting osmo-stp 16:01:56.388406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20154): Launched 16:01:56.692027 run osmo-stp_10.42.42.5(pid=20155): Launched 16:01:56.807181 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:01:57.330088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20157): Launched 16:01:57.445886 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:01:57.701860 run patchelf(pid=20158): Launched 16:01:57.870149 run osmo-stp_10.42.42.5(pid=20155): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20155)] 16:01:57.998230 run osmo-stp_10.42.42.5(pid=20155): stdout: | (launched: 2022-12-09_16:01:56.635921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:58.128219 run osmo-stp_10.42.42.5(pid=20155): stderr: | [0;m[38;5;43m20221209160156804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160156804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160156804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160156805 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160156805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160156805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160156805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:58.258396 run osmo-stp_10.42.42.5(pid=20155): stdout: | (launched: 2022-12-09_16:01:56.635921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:01:58.382106 run osmo-stp_10.42.42.5(pid=20155): stderr: | [0;m[38;5;43m20221209160156804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160156804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160156804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160156805 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160156805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160156805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160156805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:01:58.528777 run patchelf(pid=20158): Terminating (SIGINT) 16:01:58.697847 run patchelf(pid=20158): Terminated: ok {rc=0} 16:01:58.819471 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20155): Process ended prematurely: osmo-stp_10.42.42.5(pid=20155) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20155)] [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 16:01:58.828382 tst ping.py:22: Test FAILED (6.5 sec) 16:01:58.855330 run osmo-hlr_10.42.42.2(pid=20152): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20152)] 16:01:58.903432 run osmo-hlr_10.42.42.2(pid=20152): stdout: | (launched: 2022-12-09_16:01:55.680342) 16:01:58.953333 run osmo-hlr_10.42.42.2(pid=20152): stderr: | [0;m[1;31m20221209160155855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160155855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160155855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160155855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160155856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160155856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160155868 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160155877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160155877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160155877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:01:59.003695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20151): Terminating (SIGTERM) 16:01:59.043744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20154): Terminating (SIGTERM) 16:01:59.084117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20157): Terminating (SIGTERM) 16:01:59.124535 --- ParallelTerminationStrategy: PID 20151 died... 16:01:59.143896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20151): Terminated: ok {rc=0} 16:01:59.188919 --- ParallelTerminationStrategy: PID 20154 died... 16:01:59.207739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20154): Terminated: ok {rc=0} 16:01:59.251671 --- ParallelTerminationStrategy: PID 20157 died... 16:01:59.270351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20157): Terminated: ok {rc=0} 16:01:59.356741 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:02:00.446382 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:00.458474 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:02:00.530701 tst ping_idle_ping.py: using LAC 22147 16:02:00.650970 tst ping_idle_ping.py: using RAC 217 16:02:00.768700 tst ping_idle_ping.py: using CellId 22147 16:02:00.902194 tst ping_idle_ping.py: using BVCI 22148 16:02:01.014456 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:01.027049 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:01.038902 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:01.050840 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:01.062715 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:01.074665 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:01.086302 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:02:01.097628 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:02:01.218296 tst ping_idle_ping.py:24: start network... 16:02:01.473657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:02:01.960039 run create_hlr_db(pid=20159): Launched 16:02:02.118425 bus /gobi_6: Setting Powered False 16:02:03.180191 run create_hlr_db(pid=20159): Terminated: ok {rc=0} 16:02:03.625345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20161): Launched 16:02:03.950308 run osmo-hlr_10.42.42.2(pid=20162): Launched 16:02:04.074964 run osmo-stp_10.42.42.5: Starting osmo-stp 16:02:04.631096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20164): Launched 16:02:04.957543 run osmo-stp_10.42.42.5(pid=20165): Launched 16:02:05.083049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:02:05.641601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20167): Launched 16:02:05.765632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:02:06.039722 run patchelf(pid=20168): Launched 16:02:06.221057 run osmo-stp_10.42.42.5(pid=20165): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20165)] 16:02:06.358473 run osmo-stp_10.42.42.5(pid=20165): stdout: | (launched: 2022-12-09_16:02:04.898062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:06.497815 run osmo-stp_10.42.42.5(pid=20165): stderr: | [0;m[38;5;43m20221209160205089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160205089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160205090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160205090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160205090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160205091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160205091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:06.637196 run osmo-stp_10.42.42.5(pid=20165): stdout: | (launched: 2022-12-09_16:02:04.898062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:06.770354 run osmo-stp_10.42.42.5(pid=20165): stderr: | [0;m[38;5;43m20221209160205089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160205089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160205090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160205090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160205090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160205091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160205091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:06.928247 run patchelf(pid=20168): Terminating (SIGINT) 16:02:07.109203 run patchelf(pid=20168): Terminated: ok {rc=0} 16:02:07.239930 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20165): Process ended prematurely: osmo-stp_10.42.42.5(pid=20165) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20165)] [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:02:07.249714 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 16:02:07.278148 run osmo-hlr_10.42.42.2(pid=20162): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20162)] 16:02:07.329336 run osmo-hlr_10.42.42.2(pid=20162): stdout: | (launched: 2022-12-09_16:02:03.890645) 16:02:07.381800 run osmo-hlr_10.42.42.2(pid=20162): stderr: | [0;m[1;31m20221209160204088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160204088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160204088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160204088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160204088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160204088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160204100 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160204109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160204109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160204109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:02:07.434685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20161): Terminating (SIGTERM) 16:02:07.477254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20164): Terminating (SIGTERM) 16:02:07.519889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20167): Terminating (SIGTERM) 16:02:07.562822 --- ParallelTerminationStrategy: PID 20161 died... 16:02:07.583140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20161): Terminated: ok {rc=0} 16:02:07.630174 --- ParallelTerminationStrategy: PID 20164 died... 16:02:07.649920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20164): Terminated: ok {rc=0} 16:02:07.696693 --- ParallelTerminationStrategy: PID 20167 died... 16:02:07.716455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20167): Terminated: ok {rc=0} 16:02:07.805575 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:02:09.109953 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:02:09.116235 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:02:09.149417 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:02:09.187802 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:02:09.275301 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:02:09.308026 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:02:09.346351 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:02:09.941891 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:02:09.991428 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:10.002507 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:02:10.073001 tst cs_paging_gprs_active.py: using LAC 22148 16:02:10.192841 tst cs_paging_gprs_active.py: using RAC 218 16:02:10.322449 tst cs_paging_gprs_active.py: using CellId 22148 16:02:10.452842 tst cs_paging_gprs_active.py: using BVCI 22149 16:02:10.572660 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:10.584200 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:10.595516 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:10.607177 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:10.618540 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:10.630028 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:10.641616 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:10.653214 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:10.665111 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:10.784685 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:10.906507 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:02:11.130852 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:11.462997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20173): Launched 16:02:11.753490 run iperf3-srv_10.42.42.10(pid=20174): Launched 16:02:11.877375 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:02:12.100716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:12.431734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20175): Launched 16:02:12.720679 run iperf3-srv_10.42.42.10(pid=20176): Launched 16:02:12.845284 tst cs_paging_gprs_active.py:38: start network... 16:02:13.069435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:02:13.581797 run create_hlr_db(pid=20177): Launched 16:02:13.709281 bus /gobi_6: Setting Powered False 16:02:14.774049 run create_hlr_db(pid=20177): Terminated: ok {rc=0} 16:02:15.234558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20179): Launched 16:02:15.566157 run osmo-hlr_10.42.42.2(pid=20180): Launched 16:02:15.694461 run osmo-stp_10.42.42.5: Starting osmo-stp 16:02:16.317798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20182): Launched 16:02:16.663478 run osmo-stp_10.42.42.5(pid=20183): Launched 16:02:16.901348 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:02:17.554573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20185): Launched 16:02:17.676032 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:02:17.937371 run patchelf(pid=20186): Launched 16:02:18.111585 run osmo-stp_10.42.42.5(pid=20183): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20183)] 16:02:18.242255 run osmo-stp_10.42.42.5(pid=20183): stdout: | (launched: 2022-12-09_16:02:16.598970) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:18.374405 run osmo-stp_10.42.42.5(pid=20183): stderr: | [0;m[38;5;43m20221209160216845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160216845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160216845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160216846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160216846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160216846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160216846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:18.506877 run osmo-stp_10.42.42.5(pid=20183): stdout: | (launched: 2022-12-09_16:02:16.598970) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:18.633283 run osmo-stp_10.42.42.5(pid=20183): stderr: | [0;m[38;5;43m20221209160216845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160216845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160216845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160216846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160216846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160216846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160216846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:18.782997 run patchelf(pid=20186): Terminating (SIGINT) 16:02:18.956235 run patchelf(pid=20186): Terminated: ok {rc=0} 16:02:19.081538 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20183): Process ended prematurely: osmo-stp_10.42.42.5(pid=20183) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20183)] [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:02:19.091030 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 16:02:19.118263 run osmo-hlr_10.42.42.2(pid=20180): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20180)] 16:02:19.166233 run osmo-hlr_10.42.42.2(pid=20180): stdout: | (launched: 2022-12-09_16:02:15.506014) 16:02:19.215595 run osmo-hlr_10.42.42.2(pid=20180): stderr: | [0;m[1;31m20221209160215703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160215703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160215703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160215703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160215703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160215703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160215716 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160215724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160215725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160215725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:02:19.265301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20173): Terminating (SIGTERM) 16:02:19.306061 run iperf3-srv_10.42.42.10(pid=20174): Terminating (SIGTERM) 16:02:19.351743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20175): Terminating (SIGTERM) 16:02:19.394127 run iperf3-srv_10.42.42.10(pid=20176): Terminating (SIGTERM) 16:02:19.436591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20179): Terminating (SIGTERM) 16:02:19.479263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20182): Terminating (SIGTERM) 16:02:19.522533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20185): Terminating (SIGTERM) 16:02:19.565417 --- ParallelTerminationStrategy: PID 20173 died... 16:02:19.585459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20173): Terminated: ok {rc=0} 16:02:19.633564 --- ParallelTerminationStrategy: PID 20174 died... 16:02:19.652916 run iperf3-srv_10.42.42.10(pid=20174): Terminated {rc=256} 16:02:19.700076 --- ParallelTerminationStrategy: PID 20175 died... 16:02:19.719636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20175): Terminated: ok {rc=0} 16:02:19.766149 --- ParallelTerminationStrategy: PID 20176 died... 16:02:19.785650 run iperf3-srv_10.42.42.10(pid=20176): Terminated {rc=256} 16:02:19.831911 --- ParallelTerminationStrategy: PID 20179 died... 16:02:19.851469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20179): Terminated: ok {rc=0} 16:02:19.898158 --- ParallelTerminationStrategy: PID 20182 died... 16:02:19.918030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20182): Terminated: ok {rc=0} 16:02:19.964533 --- ParallelTerminationStrategy: PID 20185 died... 16:02:19.984233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20185): Terminated: ok {rc=0} 16:02:20.072437 bus /gobi_0: Setting Powered False 16:02:21.170732 bus /gobi_0: Setting Powered False 16:02:22.288274 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:02:23.438196 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:23.450554 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:02:23.526994 tst iperf3.py: using LAC 22149 16:02:23.656347 tst iperf3.py: using RAC 219 16:02:23.787598 tst iperf3.py: using CellId 22149 16:02:23.919048 tst iperf3.py: using BVCI 22150 16:02:24.040096 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:24.051565 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:24.062846 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:24.074421 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:24.085826 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:24.097493 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:24.109053 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:24.120273 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:24.131872 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:24.251611 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:02:24.460316 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:24.771102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20187): Launched 16:02:25.040743 run iperf3-srv_10.42.42.10(pid=20188): Launched 16:02:25.156376 tst iperf3.py:8: start network... 16:02:25.363911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:02:25.840147 run create_hlr_db(pid=20189): Launched 16:02:25.966885 bus /gobi_6: Setting Powered False 16:02:27.027371 run create_hlr_db(pid=20189): Terminated: ok {rc=0} 16:02:27.455761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20191): Launched 16:02:27.764112 run osmo-hlr_10.42.42.2(pid=20192): Launched 16:02:27.880355 run osmo-stp_10.42.42.5: Starting osmo-stp 16:02:28.423197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20194): Launched 16:02:28.731921 run osmo-stp_10.42.42.5(pid=20195): Launched 16:02:28.849994 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:02:29.379520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20197): Launched 16:02:29.498948 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:02:29.758814 run patchelf(pid=20198): Launched 16:02:29.930187 run osmo-stp_10.42.42.5(pid=20195): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20195)] 16:02:30.060177 run osmo-stp_10.42.42.5(pid=20195): stdout: | (launched: 2022-12-09_16:02:28.675245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:30.192339 run osmo-stp_10.42.42.5(pid=20195): stderr: | [0;m[38;5;43m20221209160228846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160228846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160228847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160228847 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160228847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160228848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160228848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:30.324133 run osmo-stp_10.42.42.5(pid=20195): stdout: | (launched: 2022-12-09_16:02:28.675245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:30.449235 run osmo-stp_10.42.42.5(pid=20195): stderr: | [0;m[38;5;43m20221209160228846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160228846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160228847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160228847 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160228847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160228848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160228848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:30.598076 run patchelf(pid=20198): Terminating (SIGINT) 16:02:30.769757 run patchelf(pid=20198): Terminated: ok {rc=0} 16:02:30.894969 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20195): Process ended prematurely: osmo-stp_10.42.42.5(pid=20195) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20195)] [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 16:02:30.905178 tst iperf3.py:8: Test FAILED (7.5 sec) 16:02:30.932763 run osmo-hlr_10.42.42.2(pid=20192): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20192)] 16:02:30.981133 run osmo-hlr_10.42.42.2(pid=20192): stdout: | (launched: 2022-12-09_16:02:27.707258) 16:02:31.030927 run osmo-hlr_10.42.42.2(pid=20192): stderr: | [0;m[1;31m20221209160227885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160227885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160227885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160227885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160227885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160227885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160227898 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160227908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160227908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160227908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:02:31.081705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20187): Terminating (SIGTERM) 16:02:31.122475 run iperf3-srv_10.42.42.10(pid=20188): Terminating (SIGTERM) 16:02:31.163069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20191): Terminating (SIGTERM) 16:02:31.203836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20194): Terminating (SIGTERM) 16:02:31.244852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20197): Terminating (SIGTERM) 16:02:31.285799 --- ParallelTerminationStrategy: PID 20187 died... 16:02:31.305213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20187): Terminated: ok {rc=0} 16:02:31.350730 --- ParallelTerminationStrategy: PID 20188 died... 16:02:31.370064 run iperf3-srv_10.42.42.10(pid=20188): Terminated {rc=256} 16:02:31.415818 --- ParallelTerminationStrategy: PID 20191 died... 16:02:31.435223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20191): Terminated: ok {rc=0} 16:02:31.480438 --- ParallelTerminationStrategy: PID 20194 died... 16:02:31.499775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20194): Terminated: ok {rc=0} 16:02:31.544796 --- ParallelTerminationStrategy: PID 20197 died... 16:02:31.563979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20197): Terminated: ok {rc=0} 16:02:31.650419 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:02:32.794898 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:32.806630 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:02:32.880787 tst iperf3m4.py: using LAC 22150 16:02:33.012327 tst iperf3m4.py: using RAC 220 16:02:33.142709 tst iperf3m4.py: using CellId 22150 16:02:33.273599 tst iperf3m4.py: using BVCI 22151 16:02:33.386930 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:33.398071 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:33.408875 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:33.420118 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:33.431026 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:33.442053 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:33.453008 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:33.463732 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:33.474771 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:33.595223 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:33.715586 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:33.833479 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:33.956430 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:02:34.181862 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:34.514200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20199): Launched 16:02:34.801592 run iperf3-srv_10.42.42.10(pid=20200): Launched 16:02:34.925698 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:02:35.148915 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:35.480642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20201): Launched 16:02:35.768028 run iperf3-srv_10.42.42.10(pid=20202): Launched 16:02:35.894813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:02:36.119141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:36.450744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20205): Launched 16:02:36.737631 run iperf3-srv_10.42.42.10(pid=20206): Launched 16:02:36.862547 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:02:37.085686 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:02:37.416647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20207): Launched 16:02:37.704260 run iperf3-srv_10.42.42.10(pid=20208): Launched 16:02:37.827681 tst iperf3m4.py:8: start network... 16:02:38.051180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:02:38.561338 run create_hlr_db(pid=20209): Launched 16:02:38.686847 bus /gobi_6: Setting Powered False 16:02:39.751913 run create_hlr_db(pid=20209): Terminated: ok {rc=0} 16:02:40.193698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20211): Launched 16:02:40.502507 run osmo-hlr_10.42.42.2(pid=20212): Launched 16:02:40.623664 run osmo-stp_10.42.42.5: Starting osmo-stp 16:02:41.172884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20214): Launched 16:02:41.480928 run osmo-stp_10.42.42.5(pid=20215): Launched 16:02:41.598584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:02:42.127768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20217): Launched 16:02:42.246735 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:02:42.507611 run patchelf(pid=20218): Launched 16:02:42.681257 run osmo-stp_10.42.42.5(pid=20215): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20215)] 16:02:42.812556 run osmo-stp_10.42.42.5(pid=20215): stdout: | (launched: 2022-12-09_16:02:41.424034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:42.945129 run osmo-stp_10.42.42.5(pid=20215): stderr: | [0;m[38;5;43m20221209160241593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160241594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160241594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160241594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160241595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160241595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160241595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:43.077676 run osmo-stp_10.42.42.5(pid=20215): stdout: | (launched: 2022-12-09_16:02:41.424034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:43.204186 run osmo-stp_10.42.42.5(pid=20215): stderr: | [0;m[38;5;43m20221209160241593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160241594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160241594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160241594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160241595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160241595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160241595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:43.353912 run patchelf(pid=20218): Terminating (SIGINT) 16:02:43.527483 run patchelf(pid=20218): Terminated: ok {rc=0} 16:02:43.652569 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20215): Process ended prematurely: osmo-stp_10.42.42.5(pid=20215) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20215)] [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:02:43.662140 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:02:43.689760 run osmo-hlr_10.42.42.2(pid=20212): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20212)] 16:02:43.737888 run osmo-hlr_10.42.42.2(pid=20212): stdout: | (launched: 2022-12-09_16:02:40.446057) 16:02:43.787522 run osmo-hlr_10.42.42.2(pid=20212): stderr: | [0;m[1;31m20221209160240624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160240624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160240624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160240624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160240624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160240624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160240637 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160240645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160240645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160240645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:02:43.837717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20199): Terminating (SIGTERM) 16:02:43.877753 run iperf3-srv_10.42.42.10(pid=20200): Terminating (SIGTERM) 16:02:43.917850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20201): Terminating (SIGTERM) 16:02:43.958027 run iperf3-srv_10.42.42.10(pid=20202): Terminating (SIGTERM) 16:02:43.998179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20205): Terminating (SIGTERM) 16:02:44.038518 run iperf3-srv_10.42.42.10(pid=20206): Terminating (SIGTERM) 16:02:44.078865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20207): Terminating (SIGTERM) 16:02:44.119723 run iperf3-srv_10.42.42.10(pid=20208): Terminating (SIGTERM) 16:02:44.159925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20211): Terminating (SIGTERM) 16:02:44.200437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20214): Terminating (SIGTERM) 16:02:44.240528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20217): Terminating (SIGTERM) 16:02:44.280895 --- ParallelTerminationStrategy: PID 20199 died... 16:02:44.300307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20199): Terminated: ok {rc=0} 16:02:44.345296 --- ParallelTerminationStrategy: PID 20200 died... 16:02:44.364121 run iperf3-srv_10.42.42.10(pid=20200): Terminated {rc=256} 16:02:44.409174 --- ParallelTerminationStrategy: PID 20201 died... 16:02:44.427872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20201): Terminated: ok {rc=0} 16:02:44.472499 --- ParallelTerminationStrategy: PID 20202 died... 16:02:44.491296 run iperf3-srv_10.42.42.10(pid=20202): Terminated {rc=256} 16:02:44.535440 --- ParallelTerminationStrategy: PID 20205 died... 16:02:44.554342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20205): Terminated: ok {rc=0} 16:02:44.598598 --- ParallelTerminationStrategy: PID 20206 died... 16:02:44.617341 run iperf3-srv_10.42.42.10(pid=20206): Terminated {rc=256} 16:02:44.661442 --- ParallelTerminationStrategy: PID 20207 died... 16:02:44.680320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20207): Terminated: ok {rc=0} 16:02:44.724742 --- ParallelTerminationStrategy: PID 20208 died... 16:02:44.743641 run iperf3-srv_10.42.42.10(pid=20208): Terminated {rc=256} 16:02:44.788083 --- ParallelTerminationStrategy: PID 20211 died... 16:02:44.806969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20211): Terminated: ok {rc=0} 16:02:44.851471 --- ParallelTerminationStrategy: PID 20214 died... 16:02:44.870384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20214): Terminated: ok {rc=0} 16:02:44.914737 --- ParallelTerminationStrategy: PID 20217 died... 16:02:44.933679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20217): Terminated: ok {rc=0} 16:02:45.020390 bus /gobi_4: Setting Powered False 16:02:46.121993 bus /gobi_4: Setting Powered False 16:02:47.237877 bus /gobi_1: Setting Powered False 16:02:48.334531 bus /gobi_1: Setting Powered False 16:02:49.450850 bus /gobi_0: Setting Powered False 16:02:50.551142 bus /gobi_0: Setting Powered False 16:02:51.667628 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:02:52.772571 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:52.784789 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:02:52.858828 tst ping.py: using LAC 22151 16:02:52.986973 tst ping.py: using RAC 221 16:02:53.113397 tst ping.py: using CellId 22151 16:02:53.241292 tst ping.py: using BVCI 22152 16:02:53.352552 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:53.364092 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:53.375143 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:53.386297 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:53.397413 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:53.408434 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:53.419695 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:02:53.430649 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:02:53.551737 tst ping.py:19: start network... 16:02:53.771633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:02:54.272395 run create_hlr_db(pid=20219): Launched 16:02:54.398637 bus /gobi_6: Setting Powered False 16:02:55.462646 run create_hlr_db(pid=20219): Terminated: ok {rc=0} 16:02:55.897698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20221): Launched 16:02:56.201521 run osmo-hlr_10.42.42.2(pid=20222): Launched 16:02:56.317540 run osmo-stp_10.42.42.5: Starting osmo-stp 16:02:56.847106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20224): Launched 16:02:57.151721 run osmo-stp_10.42.42.5(pid=20225): Launched 16:02:57.267476 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:02:57.793288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20227): Launched 16:02:57.909628 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:02:58.166652 run patchelf(pid=20228): Launched 16:02:58.337252 run osmo-stp_10.42.42.5(pid=20225): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20225)] 16:02:58.465596 run osmo-stp_10.42.42.5(pid=20225): stdout: | (launched: 2022-12-09_16:02:57.095232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:58.596658 run osmo-stp_10.42.42.5(pid=20225): stderr: | [0;m[38;5;43m20221209160257265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160257265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160257265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160257266 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160257266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160257266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160257267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:58.726859 run osmo-stp_10.42.42.5(pid=20225): stdout: | (launched: 2022-12-09_16:02:57.095232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:02:58.851095 run osmo-stp_10.42.42.5(pid=20225): stderr: | [0;m[38;5;43m20221209160257265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160257265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160257265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160257266 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160257266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160257266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160257267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:02:58.998370 run patchelf(pid=20228): Terminating (SIGINT) 16:02:59.167929 run patchelf(pid=20228): Terminated: ok {rc=0} 16:02:59.290487 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20225): Process ended prematurely: osmo-stp_10.42.42.5(pid=20225) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20225)] [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 16:02:59.299264 tst ping.py:22: Test FAILED (6.5 sec) 16:02:59.326088 run osmo-hlr_10.42.42.2(pid=20222): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20222)] 16:02:59.374005 run osmo-hlr_10.42.42.2(pid=20222): stdout: | (launched: 2022-12-09_16:02:56.145323) 16:02:59.423382 run osmo-hlr_10.42.42.2(pid=20222): stderr: | [0;m[1;31m20221209160256323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160256323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160256323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160256323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160256323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160256323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160256335 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160256344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160256344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160256345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:02:59.473591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20221): Terminating (SIGTERM) 16:02:59.513464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20224): Terminating (SIGTERM) 16:02:59.553302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20227): Terminating (SIGTERM) 16:02:59.593457 --- ParallelTerminationStrategy: PID 20221 died... 16:02:59.612430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20221): Terminated: ok {rc=0} 16:02:59.657191 --- ParallelTerminationStrategy: PID 20224 died... 16:02:59.675841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20224): Terminated: ok {rc=0} 16:02:59.720464 --- ParallelTerminationStrategy: PID 20227 died... 16:02:59.739178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20227): Terminated: ok {rc=0} 16:02:59.823585 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:03:00.927494 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:00.945585 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:03:01.021657 tst ping_idle_ping.py: using LAC 22152 16:03:01.142642 tst ping_idle_ping.py: using RAC 222 16:03:01.265376 tst ping_idle_ping.py: using CellId 22152 16:03:01.422728 tst ping_idle_ping.py: using BVCI 22153 16:03:01.539307 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:01.551113 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:01.562742 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:01.574693 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:01.586451 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:01.598314 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:01.610249 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:03:01.621921 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:03:01.741346 tst ping_idle_ping.py:24: start network... 16:03:01.999385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:03:02.515576 run create_hlr_db(pid=20230): Launched 16:03:02.641511 bus /gobi_6: Setting Powered False 16:03:03.705893 run create_hlr_db(pid=20230): Terminated: ok {rc=0} 16:03:04.141830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20232): Launched 16:03:04.446353 run osmo-hlr_10.42.42.2(pid=20233): Launched 16:03:04.563697 run osmo-stp_10.42.42.5: Starting osmo-stp 16:03:05.088206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20235): Launched 16:03:05.394426 run osmo-stp_10.42.42.5(pid=20236): Launched 16:03:05.510343 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:03:06.037322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20238): Launched 16:03:06.154111 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:03:06.411911 run patchelf(pid=20239): Launched 16:03:06.581301 run osmo-stp_10.42.42.5(pid=20236): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20236)] 16:03:06.709769 run osmo-stp_10.42.42.5(pid=20236): stdout: | (launched: 2022-12-09_16:03:05.338353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:06.840150 run osmo-stp_10.42.42.5(pid=20236): stderr: | [0;m[38;5;43m20221209160305508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160305508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160305509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160305509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160305509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160305510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160305510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:06.970763 run osmo-stp_10.42.42.5(pid=20236): stdout: | (launched: 2022-12-09_16:03:05.338353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:07.095010 run osmo-stp_10.42.42.5(pid=20236): stderr: | [0;m[38;5;43m20221209160305508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160305508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160305509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160305509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160305509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160305510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160305510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:07.242665 run patchelf(pid=20239): Terminating (SIGINT) 16:03:07.412638 run patchelf(pid=20239): Terminated: ok {rc=0} 16:03:07.535193 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20236): Process ended prematurely: osmo-stp_10.42.42.5(pid=20236) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20236)] [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:03:07.543922 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:03:07.570653 run osmo-hlr_10.42.42.2(pid=20233): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20233)] 16:03:07.617925 run osmo-hlr_10.42.42.2(pid=20233): stdout: | (launched: 2022-12-09_16:03:04.390304) 16:03:07.667046 run osmo-hlr_10.42.42.2(pid=20233): stderr: | [0;m[1;31m20221209160304567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160304568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160304568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160304568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160304568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160304568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160304582 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160304592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160304592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160304592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:03:07.717225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20232): Terminating (SIGTERM) 16:03:07.757090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20235): Terminating (SIGTERM) 16:03:07.796853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20238): Terminating (SIGTERM) 16:03:07.836923 --- ParallelTerminationStrategy: PID 20232 died... 16:03:07.855868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20232): Terminated: ok {rc=0} 16:03:07.900128 --- ParallelTerminationStrategy: PID 20235 died... 16:03:07.918833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20235): Terminated: ok {rc=0} 16:03:07.962772 --- ParallelTerminationStrategy: PID 20238 died... 16:03:07.981483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20238): Terminated: ok {rc=0} 16:03:08.067577 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:03:09.373642 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:03:09.380377 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:03:09.414062 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 16:03:09.452631 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 16:03:09.539713 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:03:09.572468 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 16:03:09.610704 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 16:03:10.216418 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 16:03:10.271752 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:10.283848 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:03:10.339350 tst cs_paging_gprs_active.py: using LAC 22153 16:03:10.470298 tst cs_paging_gprs_active.py: using RAC 223 16:03:10.599628 tst cs_paging_gprs_active.py: using CellId 22153 16:03:10.728254 tst cs_paging_gprs_active.py: using BVCI 22154 16:03:10.850337 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:10.862461 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:10.874388 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:10.886917 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:10.899591 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:10.913051 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:10.925832 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:10.937549 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:10.950680 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:11.073377 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:11.196703 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:03:11.422951 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:11.758807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20243): Launched 16:03:12.049989 run iperf3-srv_10.42.42.10(pid=20244): Launched 16:03:12.175560 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:03:12.400900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:12.736308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20245): Launched 16:03:13.027612 run iperf3-srv_10.42.42.10(pid=20246): Launched 16:03:13.152330 tst cs_paging_gprs_active.py:38: start network... 16:03:13.377039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:03:13.891443 run create_hlr_db(pid=20247): Launched 16:03:14.018932 bus /gobi_6: Setting Powered False 16:03:15.083506 run create_hlr_db(pid=20247): Terminated: ok {rc=0} 16:03:15.543911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20249): Launched 16:03:15.889768 run osmo-hlr_10.42.42.2(pid=20250): Launched 16:03:16.077619 run osmo-stp_10.42.42.5: Starting osmo-stp 16:03:16.955925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20252): Launched 16:03:17.285645 run osmo-stp_10.42.42.5(pid=20253): Launched 16:03:17.413143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:03:17.985696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20255): Launched 16:03:18.114668 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:03:18.395255 run patchelf(pid=20256): Launched 16:03:18.580135 run osmo-stp_10.42.42.5(pid=20253): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20253)] 16:03:18.720235 run osmo-stp_10.42.42.5(pid=20253): stdout: | (launched: 2022-12-09_16:03:17.223336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:18.861798 run osmo-stp_10.42.42.5(pid=20253): stderr: | [0;m[38;5;43m20221209160317415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160317415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160317416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160317416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160317416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160317417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160317417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:19.004312 run osmo-stp_10.42.42.5(pid=20253): stdout: | (launched: 2022-12-09_16:03:17.223336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:19.139655 run osmo-stp_10.42.42.5(pid=20253): stderr: | [0;m[38;5;43m20221209160317415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160317415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160317416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160317416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160317416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160317417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160317417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:19.300435 run patchelf(pid=20256): Terminating (SIGINT) 16:03:19.485844 run patchelf(pid=20256): Terminated: ok {rc=0} 16:03:19.619848 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20253): Process ended prematurely: osmo-stp_10.42.42.5(pid=20253) [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20253)] [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 16:03:19.630320 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 16:03:19.659212 run osmo-hlr_10.42.42.2(pid=20250): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20250)] 16:03:19.710190 run osmo-hlr_10.42.42.2(pid=20250): stdout: | (launched: 2022-12-09_16:03:15.817319) 16:03:19.762500 run osmo-hlr_10.42.42.2(pid=20250): stderr: | [0;m[1;31m20221209160316167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160316168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160316168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160316168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160316168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160316169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160316195 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160316233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160316234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160316235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:03:19.815814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20243): Terminating (SIGTERM) 16:03:19.858535 run iperf3-srv_10.42.42.10(pid=20244): Terminating (SIGTERM) 16:03:19.901098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20245): Terminating (SIGTERM) 16:03:19.943634 run iperf3-srv_10.42.42.10(pid=20246): Terminating (SIGTERM) 16:03:19.986320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20249): Terminating (SIGTERM) 16:03:20.029369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20252): Terminating (SIGTERM) 16:03:20.071997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20255): Terminating (SIGTERM) 16:03:20.114701 --- ParallelTerminationStrategy: PID 20243 died... 16:03:20.134754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20243): Terminated: ok {rc=0} 16:03:20.181741 --- ParallelTerminationStrategy: PID 20244 died... 16:03:20.201425 run iperf3-srv_10.42.42.10(pid=20244): Terminated {rc=256} 16:03:20.247856 --- ParallelTerminationStrategy: PID 20245 died... 16:03:20.267572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20245): Terminated: ok {rc=0} 16:03:20.314149 --- ParallelTerminationStrategy: PID 20246 died... 16:03:20.333832 run iperf3-srv_10.42.42.10(pid=20246): Terminated {rc=256} 16:03:20.380359 --- ParallelTerminationStrategy: PID 20249 died... 16:03:20.400114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20249): Terminated: ok {rc=0} 16:03:20.447212 --- ParallelTerminationStrategy: PID 20252 died... 16:03:20.466935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20252): Terminated: ok {rc=0} 16:03:20.513628 --- ParallelTerminationStrategy: PID 20255 died... 16:03:20.533407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20255): Terminated: ok {rc=0} 16:03:20.622568 bus /gobi_0: Setting Powered False 16:03:21.723164 bus /gobi_0: Setting Powered False 16:03:22.840122 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 16:03:23.984768 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:23.997201 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:03:24.053513 tst iperf3.py: using LAC 22154 16:03:24.178379 tst iperf3.py: using RAC 224 16:03:24.300634 tst iperf3.py: using CellId 22154 16:03:24.422829 tst iperf3.py: using BVCI 22155 16:03:24.536609 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:24.548018 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:24.559319 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:24.570575 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:24.581775 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:24.592838 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:24.604151 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:24.615265 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:24.626591 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:24.749540 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:03:24.975568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:25.309388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20257): Launched 16:03:25.598579 run iperf3-srv_10.42.42.10(pid=20258): Launched 16:03:25.724105 tst iperf3.py:8: start network... 16:03:25.949483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:03:26.461919 run create_hlr_db(pid=20259): Launched 16:03:26.590108 bus /gobi_6: Setting Powered False 16:03:27.654614 run create_hlr_db(pid=20259): Terminated: ok {rc=0} 16:03:28.096443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20261): Launched 16:03:28.407725 run osmo-hlr_10.42.42.2(pid=20262): Launched 16:03:28.526388 run osmo-stp_10.42.42.5: Starting osmo-stp 16:03:29.064619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20264): Launched 16:03:29.375898 run osmo-stp_10.42.42.5(pid=20265): Launched 16:03:29.493794 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:03:30.026914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20267): Launched 16:03:30.146792 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:03:30.409282 run patchelf(pid=20268): Launched 16:03:30.582045 run osmo-stp_10.42.42.5(pid=20265): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20265)] 16:03:30.712884 run osmo-stp_10.42.42.5(pid=20265): stdout: | (launched: 2022-12-09_16:03:29.319112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:30.851104 run osmo-stp_10.42.42.5(pid=20265): stderr: | [0;m[38;5;43m20221209160329492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160329492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160329492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160329492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160329493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160329493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160329493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:31.024613 run osmo-stp_10.42.42.5(pid=20265): stdout: | (launched: 2022-12-09_16:03:29.319112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:31.164411 run osmo-stp_10.42.42.5(pid=20265): stderr: | [0;m[38;5;43m20221209160329492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160329492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160329492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160329492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160329493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160329493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160329493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:31.330879 run patchelf(pid=20268): Terminating (SIGINT) 16:03:31.525671 run patchelf(pid=20268): Terminated: ok {rc=0} 16:03:31.664174 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20265): Process ended prematurely: osmo-stp_10.42.42.5(pid=20265) [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20265)] [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 16:03:31.675653 tst iperf3.py:8: Test FAILED (7.7 sec) 16:03:31.709227 run osmo-hlr_10.42.42.2(pid=20262): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20262)] 16:03:31.762748 run osmo-hlr_10.42.42.2(pid=20262): stdout: | (launched: 2022-12-09_16:03:28.350712) 16:03:31.818568 run osmo-hlr_10.42.42.2(pid=20262): stderr: | [0;m[1;31m20221209160328529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160328529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160328529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160328529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160328529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160328529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160328542 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160328551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160328551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160328551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:03:31.875449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20257): Terminating (SIGTERM) 16:03:31.921851 run iperf3-srv_10.42.42.10(pid=20258): Terminating (SIGTERM) 16:03:31.966680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20261): Terminating (SIGTERM) 16:03:32.012200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20264): Terminating (SIGTERM) 16:03:32.058810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20267): Terminating (SIGTERM) 16:03:32.106865 --- ParallelTerminationStrategy: PID 20257 died... 16:03:32.127931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20257): Terminated: ok {rc=0} 16:03:32.179272 --- ParallelTerminationStrategy: PID 20258 died... 16:03:32.199944 run iperf3-srv_10.42.42.10(pid=20258): Terminated {rc=256} 16:03:32.247623 --- ParallelTerminationStrategy: PID 20261 died... 16:03:32.267732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20261): Terminated: ok {rc=0} 16:03:32.314726 --- ParallelTerminationStrategy: PID 20264 died... 16:03:32.334690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20264): Terminated: ok {rc=0} 16:03:32.381803 --- ParallelTerminationStrategy: PID 20267 died... 16:03:32.401713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20267): Terminated: ok {rc=0} 16:03:32.491067 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 16:03:33.642818 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:33.655667 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:03:33.715598 tst iperf3m4.py: using LAC 22155 16:03:33.842882 tst iperf3m4.py: using RAC 225 16:03:33.970345 tst iperf3m4.py: using CellId 22155 16:03:34.099473 tst iperf3m4.py: using BVCI 22156 16:03:34.220306 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:34.232285 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:34.244062 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:34.256087 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:34.268055 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:34.280059 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:34.292366 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:34.304352 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:34.316733 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:34.438214 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:34.560101 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:34.682451 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:34.804172 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:03:35.029710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:35.363476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20269): Launched 16:03:35.654442 run iperf3-srv_10.42.42.10(pid=20270): Launched 16:03:35.780137 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:03:36.005765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:36.339118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20271): Launched 16:03:36.629971 run iperf3-srv_10.42.42.10(pid=20272): Launched 16:03:36.755497 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:03:36.980333 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:37.313887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20273): Launched 16:03:37.603962 run iperf3-srv_10.42.42.10(pid=20274): Launched 16:03:37.729541 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:03:37.954245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:03:38.287189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20275): Launched 16:03:38.577926 run iperf3-srv_10.42.42.10(pid=20276): Launched 16:03:38.703444 tst iperf3m4.py:8: start network... 16:03:38.927236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:03:39.440121 run create_hlr_db(pid=20277): Launched 16:03:39.567729 bus /gobi_6: Setting Powered False 16:03:40.632272 run create_hlr_db(pid=20277): Terminated: ok {rc=0} 16:03:41.091170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20279): Launched 16:03:41.423260 run osmo-hlr_10.42.42.2(pid=20280): Launched 16:03:41.551314 run osmo-stp_10.42.42.5: Starting osmo-stp 16:03:42.128763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20282): Launched 16:03:42.460423 run osmo-stp_10.42.42.5(pid=20283): Launched 16:03:42.588534 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:03:43.158754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20285): Launched 16:03:43.287015 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:03:43.565663 run patchelf(pid=20286): Launched 16:03:43.749206 run osmo-stp_10.42.42.5(pid=20283): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20283)] 16:03:43.888238 run osmo-stp_10.42.42.5(pid=20283): stdout: | (launched: 2022-12-09_16:03:42.399938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:44.029815 run osmo-stp_10.42.42.5(pid=20283): stderr: | [0;m[38;5;43m20221209160342590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160342590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160342590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160342591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160342591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160342591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160342591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:44.170872 run osmo-stp_10.42.42.5(pid=20283): stdout: | (launched: 2022-12-09_16:03:42.399938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:44.305206 run osmo-stp_10.42.42.5(pid=20283): stderr: | [0;m[38;5;43m20221209160342590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160342590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160342590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160342591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160342591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160342591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160342591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:44.464758 run patchelf(pid=20286): Terminating (SIGINT) 16:03:44.649248 run patchelf(pid=20286): Terminated: ok {rc=0} 16:03:44.782462 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20283): Process ended prematurely: osmo-stp_10.42.42.5(pid=20283) [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20283)] [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 16:03:44.792865 tst iperf3m4.py:8: Test FAILED (11.2 sec) 16:03:44.822503 run osmo-hlr_10.42.42.2(pid=20280): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20280)] 16:03:44.872877 run osmo-hlr_10.42.42.2(pid=20280): stdout: | (launched: 2022-12-09_16:03:41.362872) 16:03:44.925240 run osmo-hlr_10.42.42.2(pid=20280): stderr: | [0;m[1;31m20221209160341559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160341559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160341559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160341559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160341559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160341559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160341571 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160341580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160341580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160341580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:03:44.978132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20269): Terminating (SIGTERM) 16:03:45.020208 run iperf3-srv_10.42.42.10(pid=20270): Terminating (SIGTERM) 16:03:45.062340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20271): Terminating (SIGTERM) 16:03:45.104387 run iperf3-srv_10.42.42.10(pid=20272): Terminating (SIGTERM) 16:03:45.146436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20273): Terminating (SIGTERM) 16:03:45.188505 run iperf3-srv_10.42.42.10(pid=20274): Terminating (SIGTERM) 16:03:45.230590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20275): Terminating (SIGTERM) 16:03:45.272695 run iperf3-srv_10.42.42.10(pid=20276): Terminating (SIGTERM) 16:03:45.314640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20279): Terminating (SIGTERM) 16:03:45.356795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20282): Terminating (SIGTERM) 16:03:45.398898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20285): Terminating (SIGTERM) 16:03:45.441229 --- ParallelTerminationStrategy: PID 20269 died... 16:03:45.461349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20269): Terminated: ok {rc=0} 16:03:45.508090 --- ParallelTerminationStrategy: PID 20270 died... 16:03:45.527622 run iperf3-srv_10.42.42.10(pid=20270): Terminated {rc=256} 16:03:45.573991 --- ParallelTerminationStrategy: PID 20271 died... 16:03:45.593468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20271): Terminated: ok {rc=0} 16:03:45.639913 --- ParallelTerminationStrategy: PID 20272 died... 16:03:45.659377 run iperf3-srv_10.42.42.10(pid=20272): Terminated {rc=256} 16:03:45.705767 --- ParallelTerminationStrategy: PID 20273 died... 16:03:45.725309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20273): Terminated: ok {rc=0} 16:03:45.771542 --- ParallelTerminationStrategy: PID 20274 died... 16:03:45.790906 run iperf3-srv_10.42.42.10(pid=20274): Terminated {rc=256} 16:03:45.837535 --- ParallelTerminationStrategy: PID 20275 died... 16:03:45.861484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20275): Terminated: ok {rc=0} 16:03:45.908704 --- ParallelTerminationStrategy: PID 20276 died... 16:03:45.928776 run iperf3-srv_10.42.42.10(pid=20276): Terminated {rc=256} 16:03:45.976126 --- ParallelTerminationStrategy: PID 20279 died... 16:03:45.996084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20279): Terminated: ok {rc=0} 16:03:46.043713 --- ParallelTerminationStrategy: PID 20282 died... 16:03:46.063843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20282): Terminated: ok {rc=0} 16:03:46.111240 --- ParallelTerminationStrategy: PID 20285 died... 16:03:46.131294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20285): Terminated: ok {rc=0} 16:03:46.219667 bus /gobi_4: Setting Powered False 16:03:47.322729 bus /gobi_4: Setting Powered False 16:03:48.438024 bus /gobi_1: Setting Powered False 16:03:49.537142 bus /gobi_1: Setting Powered False 16:03:50.653093 bus /gobi_0: Setting Powered False 16:03:51.751384 bus /gobi_0: Setting Powered False 16:03:52.867784 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 16:03:53.970620 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:53.983279 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:03:54.038372 tst ping.py: using LAC 22156 16:03:54.159572 tst ping.py: using RAC 226 16:03:54.279467 tst ping.py: using CellId 22156 16:03:54.400328 tst ping.py: using BVCI 22157 16:03:54.508823 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:54.520432 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:54.531888 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:54.543202 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:54.554328 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:54.565548 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:54.576824 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:03:54.588016 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:03:54.708191 tst ping.py:19: start network... 16:03:54.928338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:03:55.429987 run create_hlr_db(pid=20287): Launched 16:03:55.555291 bus /gobi_6: Setting Powered False 16:03:56.619159 run create_hlr_db(pid=20287): Terminated: ok {rc=0} 16:03:57.052841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20289): Launched 16:03:57.356502 run osmo-hlr_10.42.42.2(pid=20290): Launched 16:03:57.471866 run osmo-stp_10.42.42.5: Starting osmo-stp 16:03:58.008778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20292): Launched 16:03:58.312708 run osmo-stp_10.42.42.5(pid=20293): Launched 16:03:58.427327 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:03:58.950295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20295): Launched 16:03:59.066570 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:03:59.323073 run patchelf(pid=20296): Launched 16:03:59.492101 run osmo-stp_10.42.42.5(pid=20293): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20293)] 16:03:59.619877 run osmo-stp_10.42.42.5(pid=20293): stdout: | (launched: 2022-12-09_16:03:58.256430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:03:59.749916 run osmo-stp_10.42.42.5(pid=20293): stderr: | [0;m[38;5;43m20221209160358427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160358427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160358427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160358428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160358428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160358428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160358428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:03:59.879834 run osmo-stp_10.42.42.5(pid=20293): stdout: | (launched: 2022-12-09_16:03:58.256430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:00.004701 run osmo-stp_10.42.42.5(pid=20293): stderr: | [0;m[38;5;43m20221209160358427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160358427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160358427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160358428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160358428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160358428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160358428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:00.152233 run patchelf(pid=20296): Terminating (SIGINT) 16:04:00.322433 run patchelf(pid=20296): Terminated: ok {rc=0} 16:04:00.445171 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20293): Process ended prematurely: osmo-stp_10.42.42.5(pid=20293) [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20293)] [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 16:04:00.454082 tst ping.py:22: Test FAILED (6.5 sec) 16:04:00.480829 run osmo-hlr_10.42.42.2(pid=20290): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20290)] 16:04:00.528801 run osmo-hlr_10.42.42.2(pid=20290): stdout: | (launched: 2022-12-09_16:03:57.300156) 16:04:00.578442 run osmo-hlr_10.42.42.2(pid=20290): stderr: | [0;m[1;31m20221209160357476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160357476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160357476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160357476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160357476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160357476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160357489 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160357499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160357499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160357499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:04:00.628588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20289): Terminating (SIGTERM) 16:04:00.668824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20292): Terminating (SIGTERM) 16:04:00.708821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20295): Terminating (SIGTERM) 16:04:00.749112 --- ParallelTerminationStrategy: PID 20289 died... 16:04:00.768422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20289): Terminated: ok {rc=0} 16:04:00.812837 --- ParallelTerminationStrategy: PID 20292 died... 16:04:00.835359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20292): Terminated: ok {rc=0} 16:04:00.882361 --- ParallelTerminationStrategy: PID 20295 died... 16:04:00.919037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20295): Terminated: ok {rc=0} 16:04:01.004419 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 16:04:02.108025 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:02.122252 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:04:02.183298 tst ping_idle_ping.py: using LAC 22157 16:04:02.324089 tst ping_idle_ping.py: using RAC 227 16:04:02.452848 tst ping_idle_ping.py: using CellId 22157 16:04:02.582239 tst ping_idle_ping.py: using BVCI 22158 16:04:02.701298 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:02.713280 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:02.724999 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:02.737519 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:02.749841 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:02.762232 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:02.774843 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:04:02.787404 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:04:02.910322 tst ping_idle_ping.py:24: start network... 16:04:03.117605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:04:03.592243 run create_hlr_db(pid=20297): Launched 16:04:03.718099 bus /gobi_6: Setting Powered False 16:04:04.778913 run create_hlr_db(pid=20297): Terminated: ok {rc=0} 16:04:05.204558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20299): Launched 16:04:05.510821 run osmo-hlr_10.42.42.2(pid=20300): Launched 16:04:05.627281 run osmo-stp_10.42.42.5: Starting osmo-stp 16:04:06.168144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20302): Launched 16:04:06.472936 run osmo-stp_10.42.42.5(pid=20303): Launched 16:04:06.589453 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:04:07.115165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20305): Launched 16:04:07.233095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:04:07.491138 run patchelf(pid=20306): Launched 16:04:07.662257 run osmo-stp_10.42.42.5(pid=20303): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20303)] 16:04:07.791163 run osmo-stp_10.42.42.5(pid=20303): stdout: | (launched: 2022-12-09_16:04:06.416695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:07.921548 run osmo-stp_10.42.42.5(pid=20303): stderr: | [0;m[38;5;43m20221209160406587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160406587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160406587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160406588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160406588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160406588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160406588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:08.051961 run osmo-stp_10.42.42.5(pid=20303): stdout: | (launched: 2022-12-09_16:04:06.416695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:08.177573 run osmo-stp_10.42.42.5(pid=20303): stderr: | [0;m[38;5;43m20221209160406587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160406587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160406587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160406588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160406588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160406588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160406588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:08.325227 run patchelf(pid=20306): Terminating (SIGINT) 16:04:08.495763 run patchelf(pid=20306): Terminated: ok {rc=0} 16:04:08.617727 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20303): Process ended prematurely: osmo-stp_10.42.42.5(pid=20303) [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20303)] [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 16:04:08.626740 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:04:08.653428 run osmo-hlr_10.42.42.2(pid=20300): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20300)] 16:04:08.701296 run osmo-hlr_10.42.42.2(pid=20300): stdout: | (launched: 2022-12-09_16:04:05.453798) 16:04:08.750552 run osmo-hlr_10.42.42.2(pid=20300): stderr: | [0;m[1;31m20221209160405631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160405631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160405631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160405631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160405631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160405631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160405643 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160405652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160405652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160405652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:04:08.800443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20299): Terminating (SIGTERM) 16:04:08.840463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20302): Terminating (SIGTERM) 16:04:08.880357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20305): Terminating (SIGTERM) 16:04:08.920355 --- ParallelTerminationStrategy: PID 20299 died... 16:04:08.939647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20299): Terminated: ok {rc=0} 16:04:08.983619 --- ParallelTerminationStrategy: PID 20302 died... 16:04:09.002435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20302): Terminated: ok {rc=0} 16:04:09.046263 --- ParallelTerminationStrategy: PID 20305 died... 16:04:09.065151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20305): Terminated: ok {rc=0} 16:04:09.150909 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:04:10.459793 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:04:10.466446 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:04:10.499913 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:04:10.534660 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:04:10.589020 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:04:10.623098 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:04:10.657828 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:04:11.214762 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:04:11.219776 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:11.231110 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:04:11.305137 tst switch_tch_pdch.py: using LAC 22158 16:04:11.423755 tst switch_tch_pdch.py: using RAC 228 16:04:11.543612 tst switch_tch_pdch.py: using CellId 22158 16:04:11.665506 tst switch_tch_pdch.py: using BVCI 22159 16:04:11.775810 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:11.787119 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:11.798248 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:11.809326 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:11.820416 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:11.831432 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:11.842637 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:04:11.853685 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:04:11.998479 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:04:12.116798 tst switch_tch_pdch.py:51: start network... 16:04:12.322384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:04:12.790910 run create_hlr_db(pid=20310): Launched 16:04:12.916483 bus /gobi_6: Setting Powered False 16:04:13.977627 run create_hlr_db(pid=20310): Terminated: ok {rc=0} 16:04:14.421434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20312): Launched 16:04:14.745997 run osmo-hlr_10.42.42.2(pid=20313): Launched 16:04:14.870969 run osmo-stp_10.42.42.5: Starting osmo-stp 16:04:15.428437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20315): Launched 16:04:15.755151 run osmo-stp_10.42.42.5(pid=20316): Launched 16:04:15.884270 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:04:16.650433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20318): Launched 16:04:16.827782 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:04:17.156750 run patchelf(pid=20319): Launched 16:04:17.349346 run osmo-stp_10.42.42.5(pid=20316): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20316)] 16:04:17.478571 run osmo-stp_10.42.42.5(pid=20316): stdout: | (launched: 2022-12-09_16:04:15.695431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:17.608663 run osmo-stp_10.42.42.5(pid=20316): stderr: | [0;m[38;5;43m20221209160415993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160415993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160415993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160415994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160415994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160415994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160415994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:17.738680 run osmo-stp_10.42.42.5(pid=20316): stdout: | (launched: 2022-12-09_16:04:15.695431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:17.862675 run osmo-stp_10.42.42.5(pid=20316): stderr: | [0;m[38;5;43m20221209160415993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160415993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160415993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160415994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160415994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160415994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160415994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:18.010140 run patchelf(pid=20319): Terminating (SIGINT) 16:04:18.179627 run patchelf(pid=20319): Terminated: ok {rc=0} 16:04:18.302694 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20316): Process ended prematurely: osmo-stp_10.42.42.5(pid=20316) [trial-2361↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20316)] [trial-2361↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:04:18.311624 tst switch_tch_pdch.py:54: Test FAILED (7.1 sec) 16:04:18.338361 run osmo-hlr_10.42.42.2(pid=20313): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20313)] 16:04:18.386303 run osmo-hlr_10.42.42.2(pid=20313): stdout: | (launched: 2022-12-09_16:04:14.686464) 16:04:18.435670 run osmo-hlr_10.42.42.2(pid=20313): stderr: | [0;m[1;31m20221209160414887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160414887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160414887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160414887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160414887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160414887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160414899 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160414907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160414908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160414908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:04:18.485346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20312): Terminating (SIGTERM) 16:04:18.525243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20315): Terminating (SIGTERM) 16:04:18.564848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20318): Terminating (SIGTERM) 16:04:18.604778 --- ParallelTerminationStrategy: PID 20312 died... 16:04:18.624010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20312): Terminated: ok {rc=0} 16:04:18.667939 --- ParallelTerminationStrategy: PID 20315 died... 16:04:18.686549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20315): Terminated: ok {rc=0} 16:04:18.730315 --- ParallelTerminationStrategy: PID 20318 died... 16:04:18.748841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20318): Terminated: ok {rc=0} 16:04:18.833079 bus /gobi_0: Setting Powered False 16:04:19.931300 bus /gobi_0: Setting Powered False 16:04:21.049158 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:04:22.302939 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:04:22.309345 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:04:22.345051 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:04:22.381008 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:04:22.436268 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:04:22.470775 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:04:22.506432 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:04:23.059818 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:04:23.065172 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:23.076059 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:04:23.145390 tst switch_tch_pdch.py: using LAC 22159 16:04:23.265383 tst switch_tch_pdch.py: using RAC 229 16:04:23.383850 tst switch_tch_pdch.py: using CellId 22159 16:04:23.501963 tst switch_tch_pdch.py: using BVCI 22160 16:04:23.611285 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:23.622454 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:23.633413 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:23.644184 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:23.655048 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:23.665988 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:23.676928 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:04:23.687807 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:04:23.807341 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:04:23.929274 tst switch_tch_pdch.py:51: start network... 16:04:24.149459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:04:24.622395 run create_hlr_db(pid=20324): Launched 16:04:24.747565 bus /gobi_6: Setting Powered False 16:04:25.811352 run create_hlr_db(pid=20324): Terminated: ok {rc=0} 16:04:26.219294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20326): Launched 16:04:26.523324 run osmo-hlr_10.42.42.2(pid=20327): Launched 16:04:26.639522 run osmo-stp_10.42.42.5: Starting osmo-stp 16:04:27.133418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20329): Launched 16:04:27.435666 run osmo-stp_10.42.42.5(pid=20330): Launched 16:04:27.551297 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:04:28.047689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20332): Launched 16:04:28.163518 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:04:28.420616 run patchelf(pid=20333): Launched 16:04:28.589601 run osmo-stp_10.42.42.5(pid=20330): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20330)] 16:04:28.717562 run osmo-stp_10.42.42.5(pid=20330): stdout: | (launched: 2022-12-09_16:04:27.379820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:28.847281 run osmo-stp_10.42.42.5(pid=20330): stderr: | [0;m[38;5;43m20221209160427551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160427551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160427551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160427552 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160427552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160427552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160427552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:28.976812 run osmo-stp_10.42.42.5(pid=20330): stdout: | (launched: 2022-12-09_16:04:27.379820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:29.100768 run osmo-stp_10.42.42.5(pid=20330): stderr: | [0;m[38;5;43m20221209160427551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160427551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160427551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160427552 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160427552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160427552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160427552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:29.247308 run patchelf(pid=20333): Terminating (SIGINT) 16:04:29.415699 run patchelf(pid=20333): Terminated: ok {rc=0} 16:04:29.537652 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20330): Process ended prematurely: osmo-stp_10.42.42.5(pid=20330) [trial-2361↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20330)] [trial-2361↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:04:29.546511 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 16:04:29.573103 run osmo-hlr_10.42.42.2(pid=20327): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20327)] 16:04:29.621167 run osmo-hlr_10.42.42.2(pid=20327): stdout: | (launched: 2022-12-09_16:04:26.467317) 16:04:29.670325 run osmo-hlr_10.42.42.2(pid=20327): stderr: | [0;m[1;31m20221209160426644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160426644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160426644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160426644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160426644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160426644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160426656 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160426665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160426665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160426665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:04:29.720033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20326): Terminating (SIGTERM) 16:04:29.759604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20329): Terminating (SIGTERM) 16:04:29.799414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20332): Terminating (SIGTERM) 16:04:29.839284 --- ParallelTerminationStrategy: PID 20326 died... 16:04:29.858359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20326): Terminated: ok {rc=0} 16:04:29.902740 --- ParallelTerminationStrategy: PID 20329 died... 16:04:29.921335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20329): Terminated: ok {rc=0} 16:04:29.965162 --- ParallelTerminationStrategy: PID 20332 died... 16:04:29.983595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20332): Terminated: ok {rc=0} 16:04:30.067508 bus /gobi_0: Setting Powered False 16:04:31.161495 bus /gobi_0: Setting Powered False 16:04:32.275001 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 16:04:33.532854 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:04:33.537415 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:04:33.572892 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 16:04:33.580073 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:04:33.632926 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:04:33.667694 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 16:04:33.674717 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:04:34.215201 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 16:04:34.220405 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 16:04:34.231846 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:04:34.281375 tst mo_mt_sms.py: using LAC 22160 16:04:34.407669 tst mo_mt_sms.py: using RAC 230 16:04:34.536495 tst mo_mt_sms.py: using CellId 22160 16:04:34.656236 tst mo_mt_sms.py: using BVCI 22161 16:04:34.766080 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:04:34.885502 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:04:35.001482 tst mo_mt_sms.py:9: start nitb and bts... 16:04:35.207298 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:04:35.824243 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20337): Launched 16:04:36.127569 run osmo-nitb_10.42.42.2(pid=20338): Launched 16:04:36.295816 run osmo-nitb_10.42.42.2(pid=20338): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20338)] 16:04:36.432476 run osmo-nitb_10.42.42.2(pid=20338): stdout: | (launched: 2022-12-09_16:04:36.071807) 16:04:36.569885 run osmo-nitb_10.42.42.2(pid=20338): stderr: | (launched: 2022-12-09_16:04:36.116586) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:04:36.707049 run osmo-nitb_10.42.42.2(pid=20338): stdout: | (launched: 2022-12-09_16:04:36.071807) 16:04:36.838366 run osmo-nitb_10.42.42.2(pid=20338): stderr: | (launched: 2022-12-09_16:04:36.116586) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20338): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20338) [trial-2361↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20338)] 16:04:37.242126 tst osmo-nitb_10.42.42.2(pid=20338): stdout: | (launched: 2022-12-09_16:04:36.071807) 16:04:37.364375 tst osmo-nitb_10.42.42.2(pid=20338): stderr: | (launched: 2022-12-09_16:04:36.116586) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:04:37.508126 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20338): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20338) [trial-2361↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20338)] [trial-2361↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 16:04:37.516656 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 16:04:37.523378 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20337): Terminating (SIGTERM) 16:04:37.731909 --- ParallelTerminationStrategy: PID 20337 died... 16:04:37.752603 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20337): Terminated: ok {rc=0} 16:04:37.839203 bus /sierra_3: Setting Powered False 16:04:38.941047 bus /sierra_3: Setting Powered False 16:04:40.056125 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 sms:trx-sysmocell5000 --------------------------------------------------------------------- 16:04:41.252835 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:04:41.256712 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:04:41.290627 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:04:41.317519 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:04:41.371522 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:04:41.405258 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:04:41.431692 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:04:41.978806 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 16:04:41.984071 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:41.994978 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:04:42.043647 tst mo_mt_sms.py: using LAC 22161 16:04:42.161789 tst mo_mt_sms.py: using RAC 231 16:04:42.281579 tst mo_mt_sms.py: using CellId 22161 16:04:42.400608 tst mo_mt_sms.py: using BVCI 22162 16:04:42.511417 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:42.522263 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:42.532890 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:42.543514 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:42.554129 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:42.564617 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:04:42.685140 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:04:42.807568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:04:43.311548 run create_hlr_db(pid=20342): Launched 16:04:43.436869 bus /sierra_2: Setting Powered False 16:04:44.501501 run create_hlr_db(pid=20342): Terminated: ok {rc=0} 16:04:44.955978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20345): Launched 16:04:45.282683 run osmo-hlr_10.42.42.2(pid=20346): Launched 16:04:45.407323 run osmo-stp_10.42.42.5: Starting osmo-stp 16:04:45.981718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20348): Launched 16:04:46.313782 run osmo-stp_10.42.42.5(pid=20349): Launched 16:04:46.593920 run osmo-msc_10.42.42.6: Starting osmo-msc 16:04:47.193734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20351): Launched 16:04:47.504427 run osmo-msc_10.42.42.6(pid=20352): Launched 16:04:47.674247 run osmo-stp_10.42.42.5(pid=20349): ERR: Terminated: ERROR {rc=1} [trial-2361↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20349)] 16:04:47.800140 run osmo-stp_10.42.42.5(pid=20349): stdout: | (launched: 2022-12-09_16:04:46.248426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:47.927195 run osmo-stp_10.42.42.5(pid=20349): stderr: | [0;m[38;5;43m20221209160446453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160446453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160446453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160446454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160446454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160446454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160446454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:48.052368 run osmo-stp_10.42.42.5(pid=20349): stdout: | (launched: 2022-12-09_16:04:46.248426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:04:48.171992 run osmo-stp_10.42.42.5(pid=20349): stderr: | [0;m[38;5;43m20221209160446453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160446453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160446453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160446454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160446454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160446454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160446454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:04:48.315881 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20349): Process ended prematurely: osmo-stp_10.42.42.5(pid=20349) [trial-2361↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20349)] [trial-2361↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 16:04:48.324124 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 16:04:48.349943 run osmo-hlr_10.42.42.2(pid=20346): ERR: Terminated: ERROR {rc=237} [trial-2361↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20346)] 16:04:48.397439 run osmo-hlr_10.42.42.2(pid=20346): stdout: | (launched: 2022-12-09_16:04:45.222254) 16:04:48.446445 run osmo-hlr_10.42.42.2(pid=20346): stderr: | [0;m[1;31m20221209160445421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160445421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160445421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160445421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160445421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160445421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160445440 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160445449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160445449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160445449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:04:48.515436 run osmo-msc_10.42.42.6(pid=20352): ERR: Terminated: ERROR {rc=2} [trial-2361↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20352)] 16:04:48.562993 run osmo-msc_10.42.42.6(pid=20352): stdout: | (launched: 2022-12-09_16:04:47.447896) 16:04:48.611918 run osmo-msc_10.42.42.6(pid=20352): stderr: | [0;m[38;5;43m20221209160447719 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160447719 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2d4a5d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160447719 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160447719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160447720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160447720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160447722 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160447722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160447722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160447722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:04:48.661403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20345): Terminating (SIGTERM) 16:04:48.701096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20348): Terminating (SIGTERM) 16:04:48.740550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20351): Terminating (SIGTERM) 16:04:48.780348 --- ParallelTerminationStrategy: PID 20345 died... 16:04:48.799417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20345): Terminated: ok {rc=0} 16:04:48.843795 --- ParallelTerminationStrategy: PID 20348 died... 16:04:48.862365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20348): Terminated: ok {rc=0} 16:04:48.905995 --- ParallelTerminationStrategy: PID 20351 died... 16:04:48.924442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20351): Terminated: ok {rc=0} 16:04:49.011391 bus /sierra_3: Setting Powered False 16:04:50.112171 bus /sierra_3: Setting Powered False 16:04:51.227734 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 16:04:52.459256 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:04:52.462973 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:04:52.497530 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 16:04:52.508344 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 16:04:52.546396 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:04:52.581842 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 16:04:52.588858 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 16:04:53.110889 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2361 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 16:04:53.116039 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 16:04:53.127463 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:04:53.177715 tst assert_extension.py: using LAC 22162 16:04:53.304178 tst assert_extension.py: using RAC 232 16:04:53.428530 tst assert_extension.py: using CellId 22162 16:04:53.553314 tst assert_extension.py: using BVCI 22163 16:04:53.671914 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 16:04:53.786968 tst assert_extension.py:10: start nitb and bts... 16:04:53.990982 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:04:54.611643 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20358): Launched 16:04:54.916370 run osmo-nitb_10.42.42.2(pid=20359): Launched 16:04:55.084481 run osmo-nitb_10.42.42.2(pid=20359): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20359)] 16:04:55.220722 run osmo-nitb_10.42.42.2(pid=20359): stdout: | (launched: 2022-12-09_16:04:54.860066) 16:04:55.358817 run osmo-nitb_10.42.42.2(pid=20359): stderr: | (launched: 2022-12-09_16:04:54.905333) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:04:55.496378 run osmo-nitb_10.42.42.2(pid=20359): stdout: | (launched: 2022-12-09_16:04:54.860066) 16:04:55.628147 run osmo-nitb_10.42.42.2(pid=20359): stderr: | (launched: 2022-12-09_16:04:54.905333) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20359): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20359) [trial-2361↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20359)] 16:04:56.031054 tst osmo-nitb_10.42.42.2(pid=20359): stdout: | (launched: 2022-12-09_16:04:54.860066) 16:04:56.154783 tst osmo-nitb_10.42.42.2(pid=20359): stderr: | (launched: 2022-12-09_16:04:54.905333) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:04:56.299960 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20359): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20359) [trial-2361↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20359)] [trial-2361↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 16:04:56.308405 tst assert_extension.py:12: Test FAILED (3.2 sec) 16:04:56.315010 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20358): Terminating (SIGTERM) 16:04:56.525557 --- ParallelTerminationStrategy: PID 20358 died... 16:04:56.546053 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20358): Terminated: ok {rc=0} 16:04:56.634911 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 16:04:57.814101 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:04:57.818481 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:04:57.856023 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:04:57.884281 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 16:04:57.924717 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:04:57.961323 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:04:57.989870 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 16:04:58.516936 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2361 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 16:04:58.522489 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:58.533986 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:04:58.588177 tst assert_extension.py: using LAC 22163 16:04:58.714344 tst assert_extension.py: using RAC 233 16:04:58.841477 tst assert_extension.py: using CellId 22163 16:04:58.959525 tst assert_extension.py: using BVCI 22164 16:04:59.068591 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:59.079624 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:59.090613 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:59.101413 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:59.111854 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:04:59.122494 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 16:04:59.240690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:04:59.742816 run create_hlr_db(pid=20363): Launched 16:04:59.868190 bus /sierra_2: Setting Powered False 16:05:00.931014 run create_hlr_db(pid=20363): Terminated: ok {rc=0} 16:05:01.423483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20368): Launched 16:05:01.748415 run osmo-hlr_10.42.42.2(pid=20369): Launched 16:05:02.003794 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:02.657215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20371): Launched 16:05:02.960371 run osmo-stp_10.42.42.5(pid=20372): Launched 16:05:03.075089 run osmo-msc_10.42.42.6: Starting osmo-msc 16:05:03.617757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20374): Launched 16:05:03.916842 run osmo-msc_10.42.42.6(pid=20375): Launched 16:05:04.085304 run osmo-stp_10.42.42.5(pid=20372): ERR: Terminated: ERROR {rc=1} [trial-2361↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20372)] 16:05:04.212923 run osmo-stp_10.42.42.5(pid=20372): stdout: | (launched: 2022-12-09_16:05:02.904233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:04.340401 run osmo-stp_10.42.42.5(pid=20372): stderr: | [0;m[38;5;43m20221209160503074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160503075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160503075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160503075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160503076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160503076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160503076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:04.465388 run osmo-stp_10.42.42.5(pid=20372): stdout: | (launched: 2022-12-09_16:05:02.904233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:04.585138 run osmo-stp_10.42.42.5(pid=20372): stderr: | [0;m[38;5;43m20221209160503074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160503075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160503075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160503075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160503076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160503076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160503076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:04.729468 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20372): Process ended prematurely: osmo-stp_10.42.42.5(pid=20372) [trial-2361↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20372)] [trial-2361↪ussd:trx-sysmocell5000↪assert_extension.py:17] 16:05:04.737981 tst assert_extension.py:17: Test FAILED (6.2 sec) 16:05:04.764256 run osmo-hlr_10.42.42.2(pid=20369): ERR: Terminated: ERROR {rc=237} [trial-2361↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20369)] 16:05:04.812293 run osmo-hlr_10.42.42.2(pid=20369): stdout: | (launched: 2022-12-09_16:05:01.690175) 16:05:04.862011 run osmo-hlr_10.42.42.2(pid=20369): stderr: | [0;m[1;31m20221209160501920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160501920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160501920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160501920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160501920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160501920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160501936 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160501952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160501953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160501953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:04.931058 run osmo-msc_10.42.42.6(pid=20375): ERR: Terminated: ERROR {rc=2} [trial-2361↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20375)] 16:05:04.978890 run osmo-msc_10.42.42.6(pid=20375): stdout: | (launched: 2022-12-09_16:05:03.861450) 16:05:05.028238 run osmo-msc_10.42.42.6(pid=20375): stderr: | [0;m[38;5;43m20221209160504133 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160504133 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f713925bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160504133 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160504133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160504134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160504134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160504137 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160504137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160504137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160504137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:05:05.078434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20368): Terminating (SIGTERM) 16:05:05.118147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20371): Terminating (SIGTERM) 16:05:05.158163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20374): Terminating (SIGTERM) 16:05:05.198619 --- ParallelTerminationStrategy: PID 20368 died... 16:05:05.217941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20368): Terminated: ok {rc=0} 16:05:05.262467 --- ParallelTerminationStrategy: PID 20371 died... 16:05:05.281254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20371): Terminated: ok {rc=0} 16:05:05.325557 --- ParallelTerminationStrategy: PID 20374 died... 16:05:05.344259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20374): Terminated: ok {rc=0} 16:05:05.429280 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:05:06.641366 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:05:06.649032 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:05:06.685084 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:05:06.712795 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:05:06.767853 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:05:06.803183 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:05:06.830841 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:05:07.382403 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:05:07.435701 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:07.447567 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:05:07.523151 tst mo_mt_call.py: using LAC 22164 16:05:07.649973 tst mo_mt_call.py: using RAC 234 16:05:07.774670 tst mo_mt_call.py: using CellId 22164 16:05:07.899682 tst mo_mt_call.py: using BVCI 22165 16:05:08.019654 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:08.031549 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:08.043235 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:08.055422 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:08.067399 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:08.079432 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:05:08.199357 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:05:08.319097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:08.826239 run create_hlr_db(pid=20380): Launched 16:05:08.950286 bus /sierra_2: Setting Powered False 16:05:10.015248 run create_hlr_db(pid=20380): Terminated: ok {rc=0} 16:05:10.453243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20382): Launched 16:05:10.761640 run osmo-hlr_10.42.42.2(pid=20383): Launched 16:05:10.878495 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:11.408345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20385): Launched 16:05:11.717597 run osmo-stp_10.42.42.5(pid=20386): Launched 16:05:11.834170 run osmo-msc_10.42.42.6: Starting osmo-msc 16:05:12.386670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20388): Launched 16:05:12.695602 run osmo-msc_10.42.42.6(pid=20389): Launched 16:05:12.867892 run osmo-stp_10.42.42.5(pid=20386): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20386)] 16:05:12.998022 run osmo-stp_10.42.42.5(pid=20386): stdout: | (launched: 2022-12-09_16:05:11.661200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:13.127815 run osmo-stp_10.42.42.5(pid=20386): stderr: | [0;m[38;5;43m20221209160511831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160511831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160511831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160511832 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160511832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160511832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160511832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:13.255406 run osmo-stp_10.42.42.5(pid=20386): stdout: | (launched: 2022-12-09_16:05:11.661200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:13.376831 run osmo-stp_10.42.42.5(pid=20386): stderr: | [0;m[38;5;43m20221209160511831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160511831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160511831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160511832 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160511832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160511832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160511832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:13.522616 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20386): Process ended prematurely: osmo-stp_10.42.42.5(pid=20386) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20386)] [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:05:13.531610 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:05:13.557989 run osmo-hlr_10.42.42.2(pid=20383): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20383)] 16:05:13.605324 run osmo-hlr_10.42.42.2(pid=20383): stdout: | (launched: 2022-12-09_16:05:10.705320) 16:05:13.654454 run osmo-hlr_10.42.42.2(pid=20383): stderr: | [0;m[1;31m20221209160510880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160510880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160510880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160510880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160510880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160510880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160510892 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160510902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160510903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160510903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:13.723168 run osmo-msc_10.42.42.6(pid=20389): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20389)] 16:05:13.770669 run osmo-msc_10.42.42.6(pid=20389): stdout: | (launched: 2022-12-09_16:05:12.638306) 16:05:13.819863 run osmo-msc_10.42.42.6(pid=20389): stderr: | [0;m[38;5;43m20221209160512913 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160512913 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdcaa981c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160512913 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160512914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160512914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160512914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160512915 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160512916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160512916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160512916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:05:13.869753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20382): Terminating (SIGTERM) 16:05:13.909328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20385): Terminating (SIGTERM) 16:05:13.949077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20388): Terminating (SIGTERM) 16:05:13.988993 --- ParallelTerminationStrategy: PID 20382 died... 16:05:14.008150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20382): Terminated: ok {rc=0} 16:05:14.052535 --- ParallelTerminationStrategy: PID 20385 died... 16:05:14.071141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20385): Terminated: ok {rc=0} 16:05:14.115057 --- ParallelTerminationStrategy: PID 20388 died... 16:05:14.133734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20388): Terminated: ok {rc=0} 16:05:14.220045 bus /sierra_3: Setting Powered False 16:05:15.319840 bus /sierra_3: Setting Powered False 16:05:16.435473 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:05:17.589010 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:17.601657 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:05:17.674351 tst mo_mt_call_osmux.py: using LAC 22165 16:05:17.801344 tst mo_mt_call_osmux.py: using RAC 235 16:05:17.929885 tst mo_mt_call_osmux.py: using CellId 22165 16:05:18.059326 tst mo_mt_call_osmux.py: using BVCI 22166 16:05:18.179277 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:18.191054 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:18.202745 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:18.214583 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:18.226485 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:05:18.238386 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:05:18.360319 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:05:18.480288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:18.956254 run create_hlr_db(pid=20391): Launched 16:05:19.081845 bus /sierra_2: Setting Powered False 16:05:20.142714 run create_hlr_db(pid=20391): Terminated: ok {rc=0} 16:05:20.590928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20393): Launched 16:05:20.922103 run osmo-hlr_10.42.42.2(pid=20394): Launched 16:05:21.047259 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:21.609085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20396): Launched 16:05:21.937138 run osmo-stp_10.42.42.5(pid=20397): Launched 16:05:22.063521 run osmo-msc_10.42.42.6: Starting osmo-msc 16:05:22.653504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20400): Launched 16:05:22.979710 run osmo-msc_10.42.42.6(pid=20401): Launched 16:05:23.164117 run osmo-stp_10.42.42.5(pid=20397): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20397)] 16:05:23.301244 run osmo-stp_10.42.42.5(pid=20397): stdout: | (launched: 2022-12-09_16:05:21.877366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:23.439382 run osmo-stp_10.42.42.5(pid=20397): stderr: | [0;m[38;5;43m20221209160522070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160522070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160522070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160522071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160522071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160522071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160522071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:23.575869 run osmo-stp_10.42.42.5(pid=20397): stdout: | (launched: 2022-12-09_16:05:21.877366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:23.705254 run osmo-stp_10.42.42.5(pid=20397): stderr: | [0;m[38;5;43m20221209160522070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160522070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160522070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160522071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160522071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160522071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160522071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:23.860412 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20397): Process ended prematurely: osmo-stp_10.42.42.5(pid=20397) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20397)] [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:05:23.870229 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:05:23.898369 run osmo-hlr_10.42.42.2(pid=20394): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20394)] 16:05:23.948591 run osmo-hlr_10.42.42.2(pid=20394): stdout: | (launched: 2022-12-09_16:05:20.861704) 16:05:24.000360 run osmo-hlr_10.42.42.2(pid=20394): stderr: | [0;m[1;31m20221209160521059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160521059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160521059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160521059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160521059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160521059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160521072 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160521080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160521080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160521080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:24.072860 run osmo-msc_10.42.42.6(pid=20401): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20401)] 16:05:24.122769 run osmo-msc_10.42.42.6(pid=20401): stdout: | (launched: 2022-12-09_16:05:22.920128) 16:05:24.174373 run osmo-msc_10.42.42.6(pid=20401): stderr: | [0;m[38;5;43m20221209160523241 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160523242 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f747edbdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160523242 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160523242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160523242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160523242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160523244 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160523244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160523244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160523244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:05:24.226255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20393): Terminating (SIGTERM) 16:05:24.267769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20396): Terminating (SIGTERM) 16:05:24.309496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20400): Terminating (SIGTERM) 16:05:24.351636 --- ParallelTerminationStrategy: PID 20393 died... 16:05:24.371586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20393): Terminated: ok {rc=0} 16:05:24.418189 --- ParallelTerminationStrategy: PID 20396 died... 16:05:24.437559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20396): Terminated: ok {rc=0} 16:05:24.483757 --- ParallelTerminationStrategy: PID 20400 died... 16:05:24.503292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20400): Terminated: ok {rc=0} 16:05:24.590960 bus /sierra_3: Setting Powered False 16:05:25.691517 bus /sierra_3: Setting Powered False 16:05:26.806982 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:05:28.064585 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:05:28.072133 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:05:28.107460 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:05:28.135145 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:05:28.189664 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:05:28.224284 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:05:28.252042 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:05:28.804440 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:05:28.857591 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:28.869340 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:05:28.942320 tst mo_mt_call.py: using LAC 22166 16:05:29.064597 tst mo_mt_call.py: using RAC 236 16:05:29.185489 tst mo_mt_call.py: using CellId 22166 16:05:29.304450 tst mo_mt_call.py: using BVCI 22167 16:05:29.425453 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:29.437369 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:29.449171 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:29.461132 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:29.473248 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:29.485265 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:05:29.603584 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:05:29.721153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:30.193711 run create_hlr_db(pid=20407): Launched 16:05:30.318647 bus /sierra_2: Setting Powered False 16:05:31.382608 run create_hlr_db(pid=20407): Terminated: ok {rc=0} 16:05:31.864871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20409): Launched 16:05:32.195009 run osmo-hlr_10.42.42.2(pid=20410): Launched 16:05:32.323320 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:32.886146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20412): Launched 16:05:33.215026 run osmo-stp_10.42.42.5(pid=20413): Launched 16:05:33.340173 run osmo-msc_10.42.42.6: Starting osmo-msc 16:05:33.936770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20415): Launched 16:05:34.267350 run osmo-msc_10.42.42.6(pid=20416): Launched 16:05:34.449865 run osmo-stp_10.42.42.5(pid=20413): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20413)] 16:05:34.587771 run osmo-stp_10.42.42.5(pid=20413): stdout: | (launched: 2022-12-09_16:05:33.154922) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:34.726582 run osmo-stp_10.42.42.5(pid=20413): stderr: | [0;m[38;5;43m20221209160533347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160533347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160533347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160533348 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160533348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160533348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160533348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:34.864810 run osmo-stp_10.42.42.5(pid=20413): stdout: | (launched: 2022-12-09_16:05:33.154922) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:34.995147 run osmo-stp_10.42.42.5(pid=20413): stderr: | [0;m[38;5;43m20221209160533347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160533347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160533347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160533348 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160533348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160533348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160533348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:35.151853 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20413): Process ended prematurely: osmo-stp_10.42.42.5(pid=20413) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20413)] [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:05:35.161712 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:05:35.190231 run osmo-hlr_10.42.42.2(pid=20410): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20410)] 16:05:35.240630 run osmo-hlr_10.42.42.2(pid=20410): stdout: | (launched: 2022-12-09_16:05:32.136878) 16:05:35.292717 run osmo-hlr_10.42.42.2(pid=20410): stderr: | [0;m[1;31m20221209160532331 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160532331 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160532331 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160532331 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160532331 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160532332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160532343 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160532352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160532352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160532352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:35.365325 run osmo-msc_10.42.42.6(pid=20416): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20416)] 16:05:35.415504 run osmo-msc_10.42.42.6(pid=20416): stdout: | (launched: 2022-12-09_16:05:34.207188) 16:05:35.467490 run osmo-msc_10.42.42.6(pid=20416): stderr: | [0;m[38;5;43m20221209160534530 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160534530 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f65c1253c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160534530 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160534530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160534531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160534531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160534533 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160534533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160534533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160534533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:05:35.519870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20409): Terminating (SIGTERM) 16:05:35.562212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20412): Terminating (SIGTERM) 16:05:35.604275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20415): Terminating (SIGTERM) 16:05:35.646802 --- ParallelTerminationStrategy: PID 20409 died... 16:05:35.666709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20409): Terminated: ok {rc=0} 16:05:35.713495 --- ParallelTerminationStrategy: PID 20412 died... 16:05:35.733131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20412): Terminated: ok {rc=0} 16:05:35.779574 --- ParallelTerminationStrategy: PID 20415 died... 16:05:35.799215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20415): Terminated: ok {rc=0} 16:05:35.887471 bus /sierra_3: Setting Powered False 16:05:36.986969 bus /sierra_3: Setting Powered False 16:05:38.104483 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:05:39.255066 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:39.267903 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:05:39.340610 tst mo_mt_call_osmux.py: using LAC 22167 16:05:39.468890 tst mo_mt_call_osmux.py: using RAC 237 16:05:39.596199 tst mo_mt_call_osmux.py: using CellId 22167 16:05:39.724583 tst mo_mt_call_osmux.py: using BVCI 22168 16:05:39.842558 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:39.854549 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:39.866736 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:39.878393 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:39.890454 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:05:39.902487 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:05:40.020779 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:05:40.144377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:40.651855 run create_hlr_db(pid=20418): Launched 16:05:40.777961 bus /sierra_2: Setting Powered False 16:05:41.842077 run create_hlr_db(pid=20418): Terminated: ok {rc=0} 16:05:42.297670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20420): Launched 16:05:42.626110 run osmo-hlr_10.42.42.2(pid=20421): Launched 16:05:42.753063 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:43.319729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20423): Launched 16:05:43.649129 run osmo-stp_10.42.42.5(pid=20424): Launched 16:05:43.774490 run osmo-msc_10.42.42.6: Starting osmo-msc 16:05:44.367242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20426): Launched 16:05:44.696940 run osmo-msc_10.42.42.6(pid=20427): Launched 16:05:44.879633 run osmo-stp_10.42.42.5(pid=20424): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20424)] 16:05:45.017606 run osmo-stp_10.42.42.5(pid=20424): stdout: | (launched: 2022-12-09_16:05:43.589215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:45.156872 run osmo-stp_10.42.42.5(pid=20424): stderr: | [0;m[38;5;43m20221209160543782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160543783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160543783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160543783 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160543784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160543784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160543784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:45.294698 run osmo-stp_10.42.42.5(pid=20424): stdout: | (launched: 2022-12-09_16:05:43.589215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:45.424769 run osmo-stp_10.42.42.5(pid=20424): stderr: | [0;m[38;5;43m20221209160543782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160543783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160543783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160543783 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160543784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160543784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160543784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:45.580592 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20424): Process ended prematurely: osmo-stp_10.42.42.5(pid=20424) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20424)] [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:05:45.590642 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:05:45.619026 run osmo-hlr_10.42.42.2(pid=20421): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20421)] 16:05:45.669508 run osmo-hlr_10.42.42.2(pid=20421): stdout: | (launched: 2022-12-09_16:05:42.566521) 16:05:45.721665 run osmo-hlr_10.42.42.2(pid=20421): stderr: | [0;m[1;31m20221209160542765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160542765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160542765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160542765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160542765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160542765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160542778 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160542786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160542786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160542787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:45.794079 run osmo-msc_10.42.42.6(pid=20427): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20427)] 16:05:45.862932 run osmo-msc_10.42.42.6(pid=20427): stdout: | (launched: 2022-12-09_16:05:44.636419) 16:05:45.919935 run osmo-msc_10.42.42.6(pid=20427): stderr: | [0;m[38;5;43m20221209160544963 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160544963 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f71c0fa1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160544963 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160544963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160544963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160544963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160544965 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160544965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160544966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160544966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:05:45.973770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20420): Terminating (SIGTERM) 16:05:46.017348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20423): Terminating (SIGTERM) 16:05:46.061277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20426): Terminating (SIGTERM) 16:05:46.104831 --- ParallelTerminationStrategy: PID 20420 died... 16:05:46.125373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20420): Terminated: ok {rc=0} 16:05:46.173307 --- ParallelTerminationStrategy: PID 20423 died... 16:05:46.193335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20423): Terminated: ok {rc=0} 16:05:46.240913 --- ParallelTerminationStrategy: PID 20426 died... 16:05:46.260882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20426): Terminated: ok {rc=0} 16:05:46.351267 bus /sierra_3: Setting Powered False 16:05:47.451676 bus /sierra_3: Setting Powered False 16:05:48.568372 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:05:49.821709 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:05:49.828369 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:05:49.861707 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:05:49.888285 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:05:49.939794 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:05:49.973654 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:05:50.000557 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:05:50.553398 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:05:50.602310 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:05:50.613756 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:05:50.683816 tst mo_mt_call.py: using LAC 22168 16:05:50.802868 tst mo_mt_call.py: using RAC 238 16:05:50.924051 tst mo_mt_call.py: using CellId 22168 16:05:51.045506 tst mo_mt_call.py: using BVCI 22169 16:05:51.155976 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:05:51.167408 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:05:51.178649 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:05:51.189853 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:05:51.201172 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:05:51.212310 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:05:51.333534 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:05:51.452606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:05:51.927030 run create_hlr_db(pid=20432): Launched 16:05:52.053336 bus /sierra_2: Setting Powered False 16:05:53.114798 run create_hlr_db(pid=20432): Terminated: ok {rc=0} 16:05:53.563005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20434): Launched 16:05:53.893037 run osmo-hlr_10.42.42.2(pid=20435): Launched 16:05:54.018085 run osmo-stp_10.42.42.5: Starting osmo-stp 16:05:54.582310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20437): Launched 16:05:54.910734 run osmo-stp_10.42.42.5(pid=20438): Launched 16:05:55.035872 run osmo-msc_10.42.42.6: Starting osmo-msc 16:05:55.628783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20440): Launched 16:05:55.957970 run osmo-msc_10.42.42.6(pid=20441): Launched 16:05:56.143532 run osmo-stp_10.42.42.5(pid=20438): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20438)] 16:05:56.285456 run osmo-stp_10.42.42.5(pid=20438): stdout: | (launched: 2022-12-09_16:05:54.850354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:56.421972 run osmo-stp_10.42.42.5(pid=20438): stderr: | [0;m[38;5;43m20221209160555044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160555044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160555045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160555045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160555045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160555046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160555046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:56.558608 run osmo-stp_10.42.42.5(pid=20438): stdout: | (launched: 2022-12-09_16:05:54.850354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:05:56.688926 run osmo-stp_10.42.42.5(pid=20438): stderr: | [0;m[38;5;43m20221209160555044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160555044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160555045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160555045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160555045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160555046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160555046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:05:56.845140 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20438): Process ended prematurely: osmo-stp_10.42.42.5(pid=20438) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20438)] [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:05:56.855027 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:05:56.883492 run osmo-hlr_10.42.42.2(pid=20435): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20435)] 16:05:56.933781 run osmo-hlr_10.42.42.2(pid=20435): stdout: | (launched: 2022-12-09_16:05:53.832678) 16:05:56.985795 run osmo-hlr_10.42.42.2(pid=20435): stderr: | [0;m[1;31m20221209160554031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160554031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160554031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160554032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160554032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160554032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160554044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160554052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160554053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160554053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:05:57.058785 run osmo-msc_10.42.42.6(pid=20441): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20441)] 16:05:57.109288 run osmo-msc_10.42.42.6(pid=20441): stdout: | (launched: 2022-12-09_16:05:55.897829) 16:05:57.161273 run osmo-msc_10.42.42.6(pid=20441): stderr: | [0;m[38;5;43m20221209160556220 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160556220 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f226d018c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160556220 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160556221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160556221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160556221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160556223 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160556223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160556223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160556223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:05:57.213605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20434): Terminating (SIGTERM) 16:05:57.255625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20437): Terminating (SIGTERM) 16:05:57.297760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20440): Terminating (SIGTERM) 16:05:57.340152 --- ParallelTerminationStrategy: PID 20434 died... 16:05:57.360230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20434): Terminated: ok {rc=0} 16:05:57.407082 --- ParallelTerminationStrategy: PID 20437 died... 16:05:57.426768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20437): Terminated: ok {rc=0} 16:05:57.473335 --- ParallelTerminationStrategy: PID 20440 died... 16:05:57.492776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20440): Terminated: ok {rc=0} 16:05:57.582373 bus /sierra_3: Setting Powered False 16:05:58.678854 bus /sierra_3: Setting Powered False 16:05:59.795496 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:06:00.965475 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:06:00.983450 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:06:01.066156 tst mo_mt_call_osmux.py: using LAC 22169 16:06:01.193733 tst mo_mt_call_osmux.py: using RAC 239 16:06:01.354298 tst mo_mt_call_osmux.py: using CellId 22169 16:06:01.487139 tst mo_mt_call_osmux.py: using BVCI 22170 16:06:01.647147 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:06:01.664521 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:06:01.682487 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:06:01.702057 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:06:01.717511 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:06:01.734258 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:06:01.861668 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:06:01.982669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:02.467357 run create_hlr_db(pid=20444): Launched 16:06:02.593910 bus /sierra_2: Setting Powered False 16:06:03.655224 run create_hlr_db(pid=20444): Terminated: ok {rc=0} 16:06:04.106538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20446): Launched 16:06:04.437498 run osmo-hlr_10.42.42.2(pid=20447): Launched 16:06:04.562822 run osmo-stp_10.42.42.5: Starting osmo-stp 16:06:05.130478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20449): Launched 16:06:05.461394 run osmo-stp_10.42.42.5(pid=20450): Launched 16:06:05.586581 run osmo-msc_10.42.42.6: Starting osmo-msc 16:06:06.179290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20452): Launched 16:06:06.508116 run osmo-msc_10.42.42.6(pid=20453): Launched 16:06:06.691654 run osmo-stp_10.42.42.5(pid=20450): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20450)] 16:06:06.829742 run osmo-stp_10.42.42.5(pid=20450): stdout: | (launched: 2022-12-09_16:06:05.401232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:06.968501 run osmo-stp_10.42.42.5(pid=20450): stderr: | [0;m[38;5;43m20221209160605593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160605593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160605593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160605594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160605594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160605594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160605594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:07.106901 run osmo-stp_10.42.42.5(pid=20450): stdout: | (launched: 2022-12-09_16:06:05.401232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:07.236908 run osmo-stp_10.42.42.5(pid=20450): stderr: | [0;m[38;5;43m20221209160605593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160605593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160605593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160605594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160605594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160605594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160605594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:07.393079 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20450): Process ended prematurely: osmo-stp_10.42.42.5(pid=20450) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20450)] [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:06:07.402770 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 16:06:07.430837 run osmo-hlr_10.42.42.2(pid=20447): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20447)] 16:06:07.481497 run osmo-hlr_10.42.42.2(pid=20447): stdout: | (launched: 2022-12-09_16:06:04.377243) 16:06:07.533618 run osmo-hlr_10.42.42.2(pid=20447): stderr: | [0;m[1;31m20221209160604577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160604578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160604578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160604578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160604578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160604578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160604591 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160604601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160604601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160604602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:06:07.606183 run osmo-msc_10.42.42.6(pid=20453): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20453)] 16:06:07.656281 run osmo-msc_10.42.42.6(pid=20453): stdout: | (launched: 2022-12-09_16:06:06.448020) 16:06:07.708277 run osmo-msc_10.42.42.6(pid=20453): stderr: | [0;m[38;5;43m20221209160606770 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160606770 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6f6a776c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160606770 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160606770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160606770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160606771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160606772 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160606773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160606773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160606773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:06:07.760859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20446): Terminating (SIGTERM) 16:06:07.802852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20449): Terminating (SIGTERM) 16:06:07.845123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20452): Terminating (SIGTERM) 16:06:07.887415 --- ParallelTerminationStrategy: PID 20446 died... 16:06:07.907482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20446): Terminated: ok {rc=0} 16:06:07.956740 --- ParallelTerminationStrategy: PID 20449 died... 16:06:07.975829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20449): Terminated: ok {rc=0} 16:06:08.021097 --- ParallelTerminationStrategy: PID 20452 died... 16:06:08.039772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20452): Terminated: ok {rc=0} 16:06:08.125249 bus /sierra_3: Setting Powered False 16:06:09.223416 bus /sierra_3: Setting Powered False 16:06:10.340784 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:06:11.601166 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:06:11.608314 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:06:11.644124 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:06:11.671761 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:06:11.724035 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:06:11.758847 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:06:11.786430 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:06:12.346866 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:06:12.399822 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:12.411529 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:06:12.482458 tst mo_mt_call.py: using LAC 22170 16:06:12.610690 tst mo_mt_call.py: using RAC 240 16:06:12.736506 tst mo_mt_call.py: using CellId 22170 16:06:12.862562 tst mo_mt_call.py: using BVCI 22171 16:06:12.980698 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:12.992516 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:13.004122 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:13.015874 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:13.027795 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:13.040671 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:06:13.160510 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:06:13.279852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:13.755470 run create_hlr_db(pid=20458): Launched 16:06:13.886981 bus /sierra_2: Setting Powered False 16:06:14.949312 run create_hlr_db(pid=20458): Terminated: ok {rc=0} 16:06:15.408116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20460): Launched 16:06:15.738760 run osmo-hlr_10.42.42.2(pid=20461): Launched 16:06:15.926893 run osmo-stp_10.42.42.5: Starting osmo-stp 16:06:16.604040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20463): Launched 16:06:16.935544 run osmo-stp_10.42.42.5(pid=20464): Launched 16:06:17.153651 run osmo-msc_10.42.42.6: Starting osmo-msc 16:06:17.905751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20466): Launched 16:06:18.237217 run osmo-msc_10.42.42.6(pid=20467): Launched 16:06:18.421777 run osmo-stp_10.42.42.5(pid=20464): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20464)] 16:06:18.560295 run osmo-stp_10.42.42.5(pid=20464): stdout: | (launched: 2022-12-09_16:06:16.875108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:18.699802 run osmo-stp_10.42.42.5(pid=20464): stderr: | [0;m[38;5;43m20221209160617267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160617267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160617267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160617268 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160617268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160617268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160617268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:18.837179 run osmo-stp_10.42.42.5(pid=20464): stdout: | (launched: 2022-12-09_16:06:16.875108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:18.967777 run osmo-stp_10.42.42.5(pid=20464): stderr: | [0;m[38;5;43m20221209160617267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160617267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160617267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160617268 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160617268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160617268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160617268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:19.125148 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20464): Process ended prematurely: osmo-stp_10.42.42.5(pid=20464) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20464)] [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:06:19.134829 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 16:06:19.163169 run osmo-hlr_10.42.42.2(pid=20461): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20461)] 16:06:19.213518 run osmo-hlr_10.42.42.2(pid=20461): stdout: | (launched: 2022-12-09_16:06:15.678530) 16:06:19.265832 run osmo-hlr_10.42.42.2(pid=20461): stderr: | [0;m[1;31m20221209160615895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160615895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160615895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160615895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160615895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160615895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160615919 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160615929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160615930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160615930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:06:19.338503 run osmo-msc_10.42.42.6(pid=20467): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20467)] 16:06:19.388846 run osmo-msc_10.42.42.6(pid=20467): stdout: | (launched: 2022-12-09_16:06:18.177163) 16:06:19.440709 run osmo-msc_10.42.42.6(pid=20467): stderr: | [0;m[38;5;43m20221209160618499 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160618500 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0a159a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160618500 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160618500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160618500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160618500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160618502 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160618502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160618502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160618503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:06:19.493160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20460): Terminating (SIGTERM) 16:06:19.535327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20463): Terminating (SIGTERM) 16:06:19.577650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20466): Terminating (SIGTERM) 16:06:19.620132 --- ParallelTerminationStrategy: PID 20460 died... 16:06:19.640178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20460): Terminated: ok {rc=0} 16:06:19.686893 --- ParallelTerminationStrategy: PID 20463 died... 16:06:19.706418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20463): Terminated: ok {rc=0} 16:06:19.752794 --- ParallelTerminationStrategy: PID 20466 died... 16:06:19.772708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20466): Terminated: ok {rc=0} 16:06:19.861063 bus /sierra_3: Setting Powered False 16:06:20.960876 bus /sierra_3: Setting Powered False 16:06:22.074592 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:06:23.224796 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:23.237651 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:06:23.310259 tst mo_mt_call_osmux.py: using LAC 22171 16:06:23.439964 tst mo_mt_call_osmux.py: using RAC 241 16:06:23.567727 tst mo_mt_call_osmux.py: using CellId 22171 16:06:23.695965 tst mo_mt_call_osmux.py: using BVCI 22172 16:06:23.814438 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:23.826258 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:23.837963 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:23.849728 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:23.861599 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:06:23.873321 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:06:23.995784 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:06:24.116773 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:24.594622 run create_hlr_db(pid=20469): Launched 16:06:24.723714 bus /sierra_2: Setting Powered False 16:06:25.785604 run create_hlr_db(pid=20469): Terminated: ok {rc=0} 16:06:26.235046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20471): Launched 16:06:26.566828 run osmo-hlr_10.42.42.2(pid=20472): Launched 16:06:26.694538 run osmo-stp_10.42.42.5: Starting osmo-stp 16:06:27.265548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20474): Launched 16:06:27.595228 run osmo-stp_10.42.42.5(pid=20475): Launched 16:06:27.722120 run osmo-msc_10.42.42.6: Starting osmo-msc 16:06:28.316746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20477): Launched 16:06:28.645974 run osmo-msc_10.42.42.6(pid=20478): Launched 16:06:28.830432 run osmo-stp_10.42.42.5(pid=20475): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20475)] 16:06:28.968251 run osmo-stp_10.42.42.5(pid=20475): stdout: | (launched: 2022-12-09_16:06:27.535369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:29.108466 run osmo-stp_10.42.42.5(pid=20475): stderr: | [0;m[38;5;43m20221209160627728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160627728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160627728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160627729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160627729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160627729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160627729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:29.246550 run osmo-stp_10.42.42.5(pid=20475): stdout: | (launched: 2022-12-09_16:06:27.535369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:29.378268 run osmo-stp_10.42.42.5(pid=20475): stderr: | [0;m[38;5;43m20221209160627728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160627728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160627728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160627729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160627729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160627729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160627729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:29.534830 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20475): Process ended prematurely: osmo-stp_10.42.42.5(pid=20475) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20475)] [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:06:29.544512 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:06:29.573086 run osmo-hlr_10.42.42.2(pid=20472): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20472)] 16:06:29.623067 run osmo-hlr_10.42.42.2(pid=20472): stdout: | (launched: 2022-12-09_16:06:26.506401) 16:06:29.675431 run osmo-hlr_10.42.42.2(pid=20472): stderr: | [0;m[1;31m20221209160626707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160626707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160626707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160626707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160626707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160626707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160626723 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160626733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160626733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160626733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:06:29.747711 run osmo-msc_10.42.42.6(pid=20478): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20478)] 16:06:29.797595 run osmo-msc_10.42.42.6(pid=20478): stdout: | (launched: 2022-12-09_16:06:28.585806) 16:06:29.849108 run osmo-msc_10.42.42.6(pid=20478): stderr: | [0;m[38;5;43m20221209160628911 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160628911 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff442774c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160628911 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160628911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160628911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160628911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160628913 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160628913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160628914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160628914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:06:29.901061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20471): Terminating (SIGTERM) 16:06:29.942755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20474): Terminating (SIGTERM) 16:06:29.984404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20477): Terminating (SIGTERM) 16:06:30.026593 --- ParallelTerminationStrategy: PID 20471 died... 16:06:30.046445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20471): Terminated: ok {rc=0} 16:06:30.092803 --- ParallelTerminationStrategy: PID 20474 died... 16:06:30.112247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20474): Terminated: ok {rc=0} 16:06:30.158435 --- ParallelTerminationStrategy: PID 20477 died... 16:06:30.177790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20477): Terminated: ok {rc=0} 16:06:30.265359 bus /sierra_3: Setting Powered False 16:06:31.367778 bus /sierra_3: Setting Powered False 16:06:32.484887 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:06:33.740793 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:06:33.748048 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:06:33.783803 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:06:33.811785 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:06:33.866378 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:06:33.902434 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:06:33.930081 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:06:34.482909 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:06:34.536093 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:34.547864 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:06:34.620254 tst mo_mt_call.py: using LAC 22172 16:06:34.753816 tst mo_mt_call.py: using RAC 242 16:06:34.881062 tst mo_mt_call.py: using CellId 22172 16:06:35.006855 tst mo_mt_call.py: using BVCI 22173 16:06:35.126710 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:35.138656 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:35.150469 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:35.162603 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:35.174708 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:35.186524 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:06:35.304594 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:06:35.426457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:35.936182 run create_hlr_db(pid=20483): Launched 16:06:36.062429 bus /sierra_2: Setting Powered False 16:06:37.127242 run create_hlr_db(pid=20483): Terminated: ok {rc=0} 16:06:37.568554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20485): Launched 16:06:37.878513 run osmo-hlr_10.42.42.2(pid=20486): Launched 16:06:37.995787 run osmo-stp_10.42.42.5: Starting osmo-stp 16:06:38.525513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20488): Launched 16:06:38.833981 run osmo-stp_10.42.42.5(pid=20489): Launched 16:06:38.951316 run osmo-msc_10.42.42.6: Starting osmo-msc 16:06:39.509902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20491): Launched 16:06:39.819433 run osmo-msc_10.42.42.6(pid=20492): Launched 16:06:39.992701 run osmo-stp_10.42.42.5(pid=20489): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20489)] 16:06:40.122550 run osmo-stp_10.42.42.5(pid=20489): stdout: | (launched: 2022-12-09_16:06:38.777289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:40.252259 run osmo-stp_10.42.42.5(pid=20489): stderr: | [0;m[38;5;43m20221209160638947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160638948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160638948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160638948 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160638949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160638949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160638949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:40.380724 run osmo-stp_10.42.42.5(pid=20489): stdout: | (launched: 2022-12-09_16:06:38.777289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:40.503076 run osmo-stp_10.42.42.5(pid=20489): stderr: | [0;m[38;5;43m20221209160638947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160638948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160638948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160638948 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160638949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160638949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160638949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:40.649897 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20489): Process ended prematurely: osmo-stp_10.42.42.5(pid=20489) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20489)] [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:06:40.658902 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:06:40.685192 run osmo-hlr_10.42.42.2(pid=20486): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20486)] 16:06:40.732531 run osmo-hlr_10.42.42.2(pid=20486): stdout: | (launched: 2022-12-09_16:06:37.821604) 16:06:40.781517 run osmo-hlr_10.42.42.2(pid=20486): stderr: | [0;m[1;31m20221209160637999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160637999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160637999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160637999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160637999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160637999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160638011 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160638020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160638021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160638021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:06:40.850052 run osmo-msc_10.42.42.6(pid=20492): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20492)] 16:06:40.897441 run osmo-msc_10.42.42.6(pid=20492): stdout: | (launched: 2022-12-09_16:06:39.762486) 16:06:40.946255 run osmo-msc_10.42.42.6(pid=20492): stderr: | [0;m[38;5;43m20221209160640037 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160640037 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc811ba3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160640037 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160640037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160640037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160640038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160640039 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160640040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160640040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160640040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:06:40.995468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20485): Terminating (SIGTERM) 16:06:41.034850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20488): Terminating (SIGTERM) 16:06:41.074452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20491): Terminating (SIGTERM) 16:06:41.114620 --- ParallelTerminationStrategy: PID 20485 died... 16:06:41.133742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20485): Terminated: ok {rc=0} 16:06:41.177593 --- ParallelTerminationStrategy: PID 20488 died... 16:06:41.196302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20488): Terminated: ok {rc=0} 16:06:41.240003 --- ParallelTerminationStrategy: PID 20491 died... 16:06:41.258728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20491): Terminated: ok {rc=0} 16:06:41.345441 bus /sierra_3: Setting Powered False 16:06:42.445758 bus /sierra_3: Setting Powered False 16:06:43.562937 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:06:44.709707 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:44.722182 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:06:44.796689 tst mo_mt_call_osmux.py: using LAC 22173 16:06:44.917185 tst mo_mt_call_osmux.py: using RAC 243 16:06:45.036828 tst mo_mt_call_osmux.py: using CellId 22173 16:06:45.155925 tst mo_mt_call_osmux.py: using BVCI 22174 16:06:45.267319 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:45.278733 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:45.290026 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:45.301131 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:45.312289 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:06:45.323377 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:06:45.443357 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:06:45.565676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:46.087089 run create_hlr_db(pid=20494): Launched 16:06:46.253788 bus /sierra_2: Setting Powered False 16:06:47.314850 run create_hlr_db(pid=20494): Terminated: ok {rc=0} 16:06:47.783123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20496): Launched 16:06:48.115954 run osmo-hlr_10.42.42.2(pid=20497): Launched 16:06:48.241788 run osmo-stp_10.42.42.5: Starting osmo-stp 16:06:48.808451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20499): Launched 16:06:49.139795 run osmo-stp_10.42.42.5(pid=20500): Launched 16:06:49.264791 run osmo-msc_10.42.42.6: Starting osmo-msc 16:06:49.861532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20502): Launched 16:06:50.194178 run osmo-msc_10.42.42.6(pid=20503): Launched 16:06:50.379580 run osmo-stp_10.42.42.5(pid=20500): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20500)] 16:06:50.523267 run osmo-stp_10.42.42.5(pid=20500): stdout: | (launched: 2022-12-09_16:06:49.079615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:50.660371 run osmo-stp_10.42.42.5(pid=20500): stderr: | [0;m[38;5;43m20221209160649272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160649272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160649272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160649272 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160649273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160649273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160649273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:50.797791 run osmo-stp_10.42.42.5(pid=20500): stdout: | (launched: 2022-12-09_16:06:49.079615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:06:50.928826 run osmo-stp_10.42.42.5(pid=20500): stderr: | [0;m[38;5;43m20221209160649272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160649272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160649272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160649272 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160649273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160649273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160649273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:06:51.086076 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20500): Process ended prematurely: osmo-stp_10.42.42.5(pid=20500) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20500)] [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:06:51.095955 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:06:51.124439 run osmo-hlr_10.42.42.2(pid=20497): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20497)] 16:06:51.175028 run osmo-hlr_10.42.42.2(pid=20497): stdout: | (launched: 2022-12-09_16:06:48.055372) 16:06:51.227012 run osmo-hlr_10.42.42.2(pid=20497): stderr: | [0;m[1;31m20221209160648253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160648253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160648253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160648253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160648253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160648253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160648265 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160648274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160648274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160648274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:06:51.299632 run osmo-msc_10.42.42.6(pid=20503): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20503)] 16:06:51.349983 run osmo-msc_10.42.42.6(pid=20503): stdout: | (launched: 2022-12-09_16:06:50.133682) 16:06:51.401802 run osmo-msc_10.42.42.6(pid=20503): stderr: | [0;m[38;5;43m20221209160650455 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160650455 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0bed6c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160650455 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160650455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160650455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160650455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160650457 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160650458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160650458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160650458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:06:51.454345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20496): Terminating (SIGTERM) 16:06:51.496413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20499): Terminating (SIGTERM) 16:06:51.538703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20502): Terminating (SIGTERM) 16:06:51.581221 --- ParallelTerminationStrategy: PID 20496 died... 16:06:51.601287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20496): Terminated: ok {rc=0} 16:06:51.648164 --- ParallelTerminationStrategy: PID 20499 died... 16:06:51.667856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20499): Terminated: ok {rc=0} 16:06:51.714296 --- ParallelTerminationStrategy: PID 20502 died... 16:06:51.733911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20502): Terminated: ok {rc=0} 16:06:51.822620 bus /sierra_3: Setting Powered False 16:06:52.922498 bus /sierra_3: Setting Powered False 16:06:54.042509 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:06:55.297267 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:06:55.303802 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:06:55.337505 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:06:55.364172 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:06:55.417272 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:06:55.450932 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:06:55.477428 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:06:56.029190 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:06:56.078340 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:06:56.089847 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:06:56.160782 tst mo_mt_call.py: using LAC 22174 16:06:56.281660 tst mo_mt_call.py: using RAC 244 16:06:56.411097 tst mo_mt_call.py: using CellId 22174 16:06:56.538477 tst mo_mt_call.py: using BVCI 22175 16:06:56.657357 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:06:56.669502 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:06:56.681329 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:06:56.693542 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:06:56.705730 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:06:56.717835 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:06:56.837253 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:06:56.954491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:06:57.430807 run create_hlr_db(pid=20508): Launched 16:06:57.559903 bus /sierra_2: Setting Powered False 16:06:58.621357 run create_hlr_db(pid=20508): Terminated: ok {rc=0} 16:06:59.069681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20510): Launched 16:06:59.405764 run osmo-hlr_10.42.42.2(pid=20511): Launched 16:06:59.527360 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:00.074124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20513): Launched 16:07:00.393637 run osmo-stp_10.42.42.5(pid=20514): Launched 16:07:00.514996 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:01.120114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20516): Launched 16:07:01.456569 run osmo-msc_10.42.42.6(pid=20517): Launched 16:07:01.825190 run osmo-stp_10.42.42.5(pid=20514): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20514)] 16:07:02.093872 run osmo-stp_10.42.42.5(pid=20514): stdout: | (launched: 2022-12-09_16:07:00.335753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:02.265776 run osmo-stp_10.42.42.5(pid=20514): stderr: | [0;m[38;5;43m20221209160700522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160700522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160700523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160700523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160700523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160700523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160700524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:02.399555 run osmo-stp_10.42.42.5(pid=20514): stdout: | (launched: 2022-12-09_16:07:00.335753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:02.527223 run osmo-stp_10.42.42.5(pid=20514): stderr: | [0;m[38;5;43m20221209160700522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160700522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160700523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160700523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160700523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160700523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160700524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:02.679771 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20514): Process ended prematurely: osmo-stp_10.42.42.5(pid=20514) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20514)] [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:07:02.689444 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 16:07:02.717381 run osmo-hlr_10.42.42.2(pid=20511): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20511)] 16:07:02.767350 run osmo-hlr_10.42.42.2(pid=20511): stdout: | (launched: 2022-12-09_16:06:59.348058) 16:07:02.818991 run osmo-hlr_10.42.42.2(pid=20511): stderr: | [0;m[1;31m20221209160659540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160659540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160659540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160659540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160659540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160659541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160659553 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160659561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160659562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160659562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:02.890853 run osmo-msc_10.42.42.6(pid=20517): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20517)] 16:07:02.940932 run osmo-msc_10.42.42.6(pid=20517): stdout: | (launched: 2022-12-09_16:07:01.397267) 16:07:02.992384 run osmo-msc_10.42.42.6(pid=20517): stderr: | [0;m[38;5;43m20221209160701886 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160701886 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc457ab9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160701886 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160701886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160701886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160701886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160701888 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160701898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160701898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160701898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:03.044241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20510): Terminating (SIGTERM) 16:07:03.086135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20513): Terminating (SIGTERM) 16:07:03.128090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20516): Terminating (SIGTERM) 16:07:03.170277 --- ParallelTerminationStrategy: PID 20510 died... 16:07:03.190057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20510): Terminated: ok {rc=0} 16:07:03.236203 --- ParallelTerminationStrategy: PID 20513 died... 16:07:03.255436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20513): Terminated: ok {rc=0} 16:07:03.301359 --- ParallelTerminationStrategy: PID 20516 died... 16:07:03.320782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20516): Terminated: ok {rc=0} 16:07:03.408791 bus /sierra_3: Setting Powered False 16:07:04.506129 bus /sierra_3: Setting Powered False 16:07:05.621496 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:07:06.765713 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:07:06.777562 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:07:06.851517 tst mo_mt_call_osmux.py: using LAC 22175 16:07:06.968739 tst mo_mt_call_osmux.py: using RAC 245 16:07:07.083840 tst mo_mt_call_osmux.py: using CellId 22175 16:07:07.209033 tst mo_mt_call_osmux.py: using BVCI 22176 16:07:07.316908 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:07:07.328340 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:07:07.339622 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:07:07.351014 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:07:07.362186 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:07:07.373335 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:07:07.492936 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:07:07.612613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:07:08.108621 run create_hlr_db(pid=20519): Launched 16:07:08.231251 bus /sierra_2: Setting Powered False 16:07:09.293767 run create_hlr_db(pid=20519): Terminated: ok {rc=0} 16:07:09.725110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20521): Launched 16:07:10.022193 run osmo-hlr_10.42.42.2(pid=20522): Launched 16:07:10.136757 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:10.646333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20525): Launched 16:07:10.942333 run osmo-stp_10.42.42.5(pid=20526): Launched 16:07:11.054496 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:11.589973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20528): Launched 16:07:11.887414 run osmo-msc_10.42.42.6(pid=20529): Launched 16:07:12.052023 run osmo-stp_10.42.42.5(pid=20526): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20526)] 16:07:12.177660 run osmo-stp_10.42.42.5(pid=20526): stdout: | (launched: 2022-12-09_16:07:10.888061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:12.303477 run osmo-stp_10.42.42.5(pid=20526): stderr: | [0;m[38;5;43m20221209160711055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160711055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160711056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160711056 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160711056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160711057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160711057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:12.427650 run osmo-stp_10.42.42.5(pid=20526): stdout: | (launched: 2022-12-09_16:07:10.888061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:12.545460 run osmo-stp_10.42.42.5(pid=20526): stderr: | [0;m[38;5;43m20221209160711055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160711055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160711056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160711056 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160711056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160711057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160711057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:12.686731 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20526): Process ended prematurely: osmo-stp_10.42.42.5(pid=20526) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20526)] [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:07:12.695396 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 16:07:12.721309 run osmo-hlr_10.42.42.2(pid=20522): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20522)] 16:07:12.768369 run osmo-hlr_10.42.42.2(pid=20522): stdout: | (launched: 2022-12-09_16:07:09.967945) 16:07:12.816887 run osmo-hlr_10.42.42.2(pid=20522): stderr: | [0;m[1;31m20221209160710144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160710144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160710144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160710144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160710144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160710144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160710157 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160710166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160710166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160710166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:12.884594 run osmo-msc_10.42.42.6(pid=20529): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20529)] 16:07:12.931164 run osmo-msc_10.42.42.6(pid=20529): stdout: | (launched: 2022-12-09_16:07:11.833294) 16:07:12.979287 run osmo-msc_10.42.42.6(pid=20529): stderr: | [0;m[38;5;43m20221209160712104 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160712104 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff0e6c38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160712104 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160712104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160712104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160712104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160712106 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160712107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160712107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160712107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:13.027899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20521): Terminating (SIGTERM) 16:07:13.066678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20525): Terminating (SIGTERM) 16:07:13.105614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20528): Terminating (SIGTERM) 16:07:13.144743 --- ParallelTerminationStrategy: PID 20521 died... 16:07:13.163433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20521): Terminated: ok {rc=0} 16:07:13.206510 --- ParallelTerminationStrategy: PID 20525 died... 16:07:13.224506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20525): Terminated: ok {rc=0} 16:07:13.267611 --- ParallelTerminationStrategy: PID 20528 died... 16:07:13.285850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20528): Terminated: ok {rc=0} 16:07:13.367701 bus /sierra_3: Setting Powered False 16:07:14.463040 bus /sierra_3: Setting Powered False 16:07:15.579199 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:07:16.868567 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:07:16.877470 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:07:16.921675 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:07:16.953506 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:07:17.014330 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:07:17.060714 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:07:17.098406 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:07:17.624077 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:07:17.673674 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:17.685292 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:07:17.755794 tst mo_mt_call.py: using LAC 22176 16:07:17.873945 tst mo_mt_call.py: using RAC 246 16:07:17.989901 tst mo_mt_call.py: using CellId 22176 16:07:18.106120 tst mo_mt_call.py: using BVCI 22177 16:07:18.215767 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:18.226868 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:18.237888 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:18.249543 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:18.261155 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:18.272368 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:07:18.393812 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:07:18.513345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:07:19.007528 run create_hlr_db(pid=20534): Launched 16:07:19.129962 bus /sierra_2: Setting Powered False 16:07:20.192364 run create_hlr_db(pid=20534): Terminated: ok {rc=0} 16:07:20.617869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20536): Launched 16:07:20.914283 run osmo-hlr_10.42.42.2(pid=20537): Launched 16:07:21.027276 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:21.574076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20539): Launched 16:07:21.894188 run osmo-stp_10.42.42.5(pid=20540): Launched 16:07:22.015756 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:22.591515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20542): Launched 16:07:22.911444 run osmo-msc_10.42.42.6(pid=20543): Launched 16:07:23.089269 run osmo-stp_10.42.42.5(pid=20540): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20540)] 16:07:23.223632 run osmo-stp_10.42.42.5(pid=20540): stdout: | (launched: 2022-12-09_16:07:21.836465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:23.358974 run osmo-stp_10.42.42.5(pid=20540): stderr: | [0;m[38;5;43m20221209160722022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160722022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160722022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160722023 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160722023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160722023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160722023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:23.492538 run osmo-stp_10.42.42.5(pid=20540): stdout: | (launched: 2022-12-09_16:07:21.836465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:23.619626 run osmo-stp_10.42.42.5(pid=20540): stderr: | [0;m[38;5;43m20221209160722022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160722022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160722022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160722023 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160722023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160722023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160722023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:23.772016 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20540): Process ended prematurely: osmo-stp_10.42.42.5(pid=20540) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20540)] [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:07:23.781668 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:07:23.809681 run osmo-hlr_10.42.42.2(pid=20537): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20537)] 16:07:23.859087 run osmo-hlr_10.42.42.2(pid=20537): stdout: | (launched: 2022-12-09_16:07:20.860204) 16:07:23.910577 run osmo-hlr_10.42.42.2(pid=20537): stderr: | [0;m[1;31m20221209160721031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160721031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160721031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160721031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160721031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160721031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160721043 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160721051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160721052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160721052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:23.981561 run osmo-msc_10.42.42.6(pid=20543): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20543)] 16:07:24.030976 run osmo-msc_10.42.42.6(pid=20543): stdout: | (launched: 2022-12-09_16:07:22.853877) 16:07:24.082532 run osmo-msc_10.42.42.6(pid=20543): stderr: | [0;m[38;5;43m20221209160723170 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160723170 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe32232dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160723171 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160723171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160723171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160723171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160723173 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160723173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160723173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160723173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:24.134094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20536): Terminating (SIGTERM) 16:07:24.175334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20539): Terminating (SIGTERM) 16:07:24.216772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20542): Terminating (SIGTERM) 16:07:24.258333 --- ParallelTerminationStrategy: PID 20536 died... 16:07:24.277991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20536): Terminated: ok {rc=0} 16:07:24.324117 --- ParallelTerminationStrategy: PID 20539 died... 16:07:24.343505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20539): Terminated: ok {rc=0} 16:07:24.390192 --- ParallelTerminationStrategy: PID 20542 died... 16:07:24.409484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20542): Terminated: ok {rc=0} 16:07:24.496842 bus /sierra_3: Setting Powered False 16:07:25.594797 bus /sierra_3: Setting Powered False 16:07:26.710191 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:07:27.854633 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:27.866413 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:07:27.937306 tst mo_mt_call_osmux.py: using LAC 22177 16:07:28.053337 tst mo_mt_call_osmux.py: using RAC 247 16:07:28.169686 tst mo_mt_call_osmux.py: using CellId 22177 16:07:28.286397 tst mo_mt_call_osmux.py: using BVCI 22178 16:07:28.394511 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:28.405532 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:28.416294 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:28.427056 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:28.438027 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:07:28.448721 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:07:28.562728 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:07:28.684813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:07:29.178540 run create_hlr_db(pid=20545): Launched 16:07:29.300339 bus /sierra_2: Setting Powered False 16:07:30.363122 run create_hlr_db(pid=20545): Terminated: ok {rc=0} 16:07:30.786719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20547): Launched 16:07:31.134580 run osmo-hlr_10.42.42.2(pid=20548): Launched 16:07:31.347256 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:32.071838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20550): Launched 16:07:32.409907 run osmo-stp_10.42.42.5(pid=20551): Launched 16:07:32.533923 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:33.118310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20553): Launched 16:07:33.442444 run osmo-msc_10.42.42.6(pid=20554): Launched 16:07:33.623752 run osmo-stp_10.42.42.5(pid=20551): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20551)] 16:07:33.759905 run osmo-stp_10.42.42.5(pid=20551): stdout: | (launched: 2022-12-09_16:07:32.351295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:33.896920 run osmo-stp_10.42.42.5(pid=20551): stderr: | [0;m[38;5;43m20221209160732539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160732539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160732539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160732539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160732540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160732540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160732540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:34.032183 run osmo-stp_10.42.42.5(pid=20551): stdout: | (launched: 2022-12-09_16:07:32.351295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:34.161844 run osmo-stp_10.42.42.5(pid=20551): stderr: | [0;m[38;5;43m20221209160732539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160732539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160732539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160732539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160732540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160732540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160732540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:34.316041 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20551): Process ended prematurely: osmo-stp_10.42.42.5(pid=20551) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20551)] [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:07:34.325683 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 16:07:34.353711 run osmo-hlr_10.42.42.2(pid=20548): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20548)] 16:07:34.403838 run osmo-hlr_10.42.42.2(pid=20548): stdout: | (launched: 2022-12-09_16:07:31.075271) 16:07:34.455863 run osmo-hlr_10.42.42.2(pid=20548): stderr: | [0;m[1;31m20221209160731437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160731437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160731437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160731437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160731437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160731437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160731464 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160731472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160731472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160731472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:34.528103 run osmo-msc_10.42.42.6(pid=20554): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20554)] 16:07:34.578477 run osmo-msc_10.42.42.6(pid=20554): stdout: | (launched: 2022-12-09_16:07:33.383687) 16:07:34.630374 run osmo-msc_10.42.42.6(pid=20554): stderr: | [0;m[38;5;43m20221209160733700 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160733700 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f62acf8ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160733700 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160733700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160733700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160733701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160733702 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160733703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160733703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160733704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:34.682552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20547): Terminating (SIGTERM) 16:07:34.724578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20550): Terminating (SIGTERM) 16:07:34.766930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20553): Terminating (SIGTERM) 16:07:34.809811 --- ParallelTerminationStrategy: PID 20547 died... 16:07:34.829786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20547): Terminated: ok {rc=0} 16:07:34.876694 --- ParallelTerminationStrategy: PID 20550 died... 16:07:34.896316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20550): Terminated: ok {rc=0} 16:07:34.942919 --- ParallelTerminationStrategy: PID 20553 died... 16:07:34.962464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20553): Terminated: ok {rc=0} 16:07:35.050570 bus /sierra_3: Setting Powered False 16:07:36.147982 bus /sierra_3: Setting Powered False 16:07:37.266440 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 16:07:38.514432 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:07:38.518754 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:07:38.552389 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:07:38.579271 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 16:07:38.662950 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:07:38.696273 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:07:38.722738 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 16:07:39.307499 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2361 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 16:07:39.312586 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:39.323526 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:07:39.373104 tst emergency_mo_mt_call.py: using LAC 22178 16:07:39.488871 tst emergency_mo_mt_call.py: using RAC 248 16:07:39.607586 tst emergency_mo_mt_call.py: using CellId 22178 16:07:39.722938 tst emergency_mo_mt_call.py: using BVCI 22179 16:07:39.828883 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:39.839769 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:39.850735 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:39.861373 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:39.872110 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:39.882748 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:07:40.000491 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:07:40.120255 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:07:40.611487 run create_hlr_db(pid=20560): Launched 16:07:40.733807 bus /sierra_2: Setting Powered False 16:07:41.797160 run create_hlr_db(pid=20560): Terminated: ok {rc=0} 16:07:42.221711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20562): Launched 16:07:42.517361 run osmo-hlr_10.42.42.2(pid=20563): Launched 16:07:42.630799 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:43.137088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20565): Launched 16:07:43.432822 run osmo-stp_10.42.42.5(pid=20566): Launched 16:07:43.553695 tst emergency_mo_mt_call.py: using MSISDN 7263 16:07:43.703531 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:44.235239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20568): Launched 16:07:44.531516 run osmo-msc_10.42.42.6(pid=20569): Launched 16:07:44.696082 run osmo-stp_10.42.42.5(pid=20566): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20566)] 16:07:44.828143 run osmo-stp_10.42.42.5(pid=20566): stdout: | (launched: 2022-12-09_16:07:43.378754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:44.962611 run osmo-stp_10.42.42.5(pid=20566): stderr: | [0;m[38;5;43m20221209160743544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160743544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160743545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160743545 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160743546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160743546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160743546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:45.085202 run osmo-stp_10.42.42.5(pid=20566): stdout: | (launched: 2022-12-09_16:07:43.378754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:45.203426 run osmo-stp_10.42.42.5(pid=20566): stderr: | [0;m[38;5;43m20221209160743544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160743544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160743545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160743545 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160743546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160743546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160743546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:45.344766 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20566): Process ended prematurely: osmo-stp_10.42.42.5(pid=20566) [trial-2361↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20566)] [trial-2361↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 16:07:45.353231 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 16:07:45.378997 run osmo-hlr_10.42.42.2(pid=20563): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20563)] 16:07:45.426444 run osmo-hlr_10.42.42.2(pid=20563): stdout: | (launched: 2022-12-09_16:07:42.462625) 16:07:45.475329 run osmo-hlr_10.42.42.2(pid=20563): stderr: | [0;m[1;31m20221209160742634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160742634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160742634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160742634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160742634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160742634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160742650 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160742658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160742659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160742659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:45.544212 run osmo-msc_10.42.42.6(pid=20569): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20569)] 16:07:45.591625 run osmo-msc_10.42.42.6(pid=20569): stdout: | (launched: 2022-12-09_16:07:44.476728) 16:07:45.640664 run osmo-msc_10.42.42.6(pid=20569): stderr: | [0;m[38;5;43m20221209160744747 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160744747 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1f8eb2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160744747 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160744747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160744747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160744748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160744749 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160744750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160744750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160744750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:45.689903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20562): Terminating (SIGTERM) 16:07:45.729322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20565): Terminating (SIGTERM) 16:07:45.768635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20568): Terminating (SIGTERM) 16:07:45.808375 --- ParallelTerminationStrategy: PID 20562 died... 16:07:45.827998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20562): Terminated: ok {rc=0} 16:07:45.902861 --- ParallelTerminationStrategy: PID 20565 died... 16:07:45.922082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20565): Terminated: ok {rc=0} 16:07:45.966455 --- ParallelTerminationStrategy: PID 20568 died... 16:07:45.985454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20568): Terminated: ok {rc=0} 16:07:46.073211 bus /sierra_3: Setting Powered False 16:07:47.170609 bus /sierra_3: Setting Powered False 16:07:48.288780 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 16:07:49.374988 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:49.387652 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:07:49.440926 tst emergency_preemptive_call.py: using LAC 22179 16:07:49.565370 tst emergency_preemptive_call.py: using RAC 249 16:07:49.688814 tst emergency_preemptive_call.py: using CellId 22179 16:07:49.811741 tst emergency_preemptive_call.py: using BVCI 22180 16:07:49.925974 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:49.937577 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:49.948749 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:49.960223 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:49.971741 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:07:49.982999 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:07:50.097393 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:07:50.215355 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:07:50.334730 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:07:50.449298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:07:50.907219 run create_hlr_db(pid=20571): Launched 16:07:51.029423 bus /sierra_2: Setting Powered False 16:07:52.088877 run create_hlr_db(pid=20571): Terminated: ok {rc=0} 16:07:52.503071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20573): Launched 16:07:52.798514 run osmo-hlr_10.42.42.2(pid=20574): Launched 16:07:52.909939 run osmo-stp_10.42.42.5: Starting osmo-stp 16:07:53.432403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20576): Launched 16:07:53.728530 run osmo-stp_10.42.42.5(pid=20577): Launched 16:07:53.851121 tst emergency_preemptive_call.py: using MSISDN 7264 16:07:54.001465 run osmo-msc_10.42.42.6: Starting osmo-msc 16:07:54.530117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20579): Launched 16:07:54.826987 run osmo-msc_10.42.42.6(pid=20580): Launched 16:07:54.992834 run osmo-stp_10.42.42.5(pid=20577): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20577)] 16:07:55.121455 run osmo-stp_10.42.42.5(pid=20577): stdout: | (launched: 2022-12-09_16:07:53.674395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:55.247118 run osmo-stp_10.42.42.5(pid=20577): stderr: | [0;m[38;5;43m20221209160753840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160753840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160753840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160753841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160753841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160753841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160753841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:55.370529 run osmo-stp_10.42.42.5(pid=20577): stdout: | (launched: 2022-12-09_16:07:53.674395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:07:55.489458 run osmo-stp_10.42.42.5(pid=20577): stderr: | [0;m[38;5;43m20221209160753840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160753840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160753840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160753841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160753841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160753841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160753841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:07:55.630790 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20577): Process ended prematurely: osmo-stp_10.42.42.5(pid=20577) [trial-2361↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20577)] [trial-2361↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 16:07:55.639023 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 16:07:55.665053 run osmo-hlr_10.42.42.2(pid=20574): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20574)] 16:07:55.712582 run osmo-hlr_10.42.42.2(pid=20574): stdout: | (launched: 2022-12-09_16:07:52.744526) 16:07:55.761813 run osmo-hlr_10.42.42.2(pid=20574): stderr: | [0;m[1;31m20221209160752918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160752918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160752918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160752918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160752918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160752918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160752930 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160752939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160752940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160752940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:07:55.830634 run osmo-msc_10.42.42.6(pid=20580): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20580)] 16:07:55.878359 run osmo-msc_10.42.42.6(pid=20580): stdout: | (launched: 2022-12-09_16:07:54.772796) 16:07:55.927675 run osmo-msc_10.42.42.6(pid=20580): stderr: | [0;m[38;5;43m20221209160755038 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209160755038 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faf18354c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209160755038 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209160755038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209160755038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209160755038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209160755040 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209160755041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209160755041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209160755041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:07:55.977133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20573): Terminating (SIGTERM) 16:07:56.016694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20576): Terminating (SIGTERM) 16:07:56.056122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20579): Terminating (SIGTERM) 16:07:56.095567 --- ParallelTerminationStrategy: PID 20573 died... 16:07:56.114434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20573): Terminated: ok {rc=0} 16:07:56.157783 --- ParallelTerminationStrategy: PID 20576 died... 16:07:56.176036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20576): Terminated: ok {rc=0} 16:07:56.219410 --- ParallelTerminationStrategy: PID 20579 died... 16:07:56.237756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20579): Terminated: ok {rc=0} 16:07:56.323437 bus /sierra_9: Setting Powered False 16:07:57.423329 bus /sierra_9: Setting Powered False 16:07:58.537916 bus /sierra_8: Setting Powered False 16:07:59.635878 bus /sierra_8: Setting Powered False 16:08:00.749103 bus /sierra_3: Setting Powered False 16:08:01.856052 bus /sierra_3: Setting Powered False 16:08:03.033092 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 16:08:04.339650 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:08:04.345508 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:08:04.384126 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 16:08:04.426326 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 16:08:04.517753 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:08:04.554551 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 16:08:04.596553 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 16:08:05.190436 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 16:08:05.248672 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:05.261051 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:08:05.314728 tst cs_paging_gprs_active.py: using LAC 22180 16:08:05.443736 tst cs_paging_gprs_active.py: using RAC 250 16:08:05.575218 tst cs_paging_gprs_active.py: using CellId 22180 16:08:05.701781 tst cs_paging_gprs_active.py: using BVCI 22181 16:08:05.811880 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:05.822818 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:05.834050 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:05.845196 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:05.856305 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:05.867542 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:05.878897 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:05.889986 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:05.901402 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:06.019981 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:06.140114 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:08:06.350615 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:08:06.659357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20857): Launched 16:08:06.939723 run iperf3-srv_10.42.42.10(pid=20858): Launched 16:08:07.071692 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:08:07.278780 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:08:07.587998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20859): Launched 16:08:07.871681 run iperf3-srv_10.42.42.10(pid=20860): Launched 16:08:08.003122 tst cs_paging_gprs_active.py:38: start network... 16:08:08.211822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:08.692803 run create_hlr_db(pid=20861): Launched 16:08:08.855540 bus /sierra_2: Setting Powered False 16:08:09.918246 run create_hlr_db(pid=20861): Terminated: ok {rc=0} 16:08:10.366053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20863): Launched 16:08:10.696213 run osmo-hlr_10.42.42.2(pid=20864): Launched 16:08:10.944689 run osmo-stp_10.42.42.5: Starting osmo-stp 16:08:11.659063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20866): Launched 16:08:11.990550 run osmo-stp_10.42.42.5(pid=20867): Launched 16:08:12.239402 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:08:12.919088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20869): Launched 16:08:13.052438 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:08:13.320330 run patchelf(pid=20870): Launched 16:08:13.510051 run osmo-stp_10.42.42.5(pid=20867): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20867)] 16:08:13.644669 run osmo-stp_10.42.42.5(pid=20867): stdout: | (launched: 2022-12-09_16:08:11.933318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:13.781340 run osmo-stp_10.42.42.5(pid=20867): stderr: | [0;m[38;5;43m20221209160812255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160812255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160812255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160812256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160812261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160812261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160812261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:13.918248 run osmo-stp_10.42.42.5(pid=20867): stdout: | (launched: 2022-12-09_16:08:11.933318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:14.047791 run osmo-stp_10.42.42.5(pid=20867): stderr: | [0;m[38;5;43m20221209160812255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160812255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160812255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160812256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160812261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160812261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160812261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:14.201875 run patchelf(pid=20870): Terminating (SIGINT) 16:08:14.379826 run patchelf(pid=20870): Terminated: ok {rc=0} 16:08:14.508162 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20867): Process ended prematurely: osmo-stp_10.42.42.5(pid=20867) [trial-2361↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20867)] [trial-2361↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 16:08:14.518935 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 16:08:14.548315 run osmo-hlr_10.42.42.2(pid=20864): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20864)] 16:08:14.598514 run osmo-hlr_10.42.42.2(pid=20864): stdout: | (launched: 2022-12-09_16:08:10.638380) 16:08:14.649693 run osmo-hlr_10.42.42.2(pid=20864): stderr: | [0;m[1;31m20221209160810977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160810977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160810977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160810977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160810977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160810977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160810994 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160811011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160811011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160811011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:08:14.701542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20857): Terminating (SIGTERM) 16:08:14.743917 run iperf3-srv_10.42.42.10(pid=20858): Terminating (SIGTERM) 16:08:14.788746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20859): Terminating (SIGTERM) 16:08:14.831554 run iperf3-srv_10.42.42.10(pid=20860): Terminating (SIGTERM) 16:08:14.875841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20863): Terminating (SIGTERM) 16:08:14.918728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20866): Terminating (SIGTERM) 16:08:14.961840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20869): Terminating (SIGTERM) 16:08:15.005606 --- ParallelTerminationStrategy: PID 20857 died... 16:08:15.026048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20857): Terminated: ok {rc=0} 16:08:15.074063 --- ParallelTerminationStrategy: PID 20858 died... 16:08:15.093289 run iperf3-srv_10.42.42.10(pid=20858): Terminated {rc=256} 16:08:15.139455 --- ParallelTerminationStrategy: PID 20859 died... 16:08:15.158831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20859): Terminated: ok {rc=0} 16:08:15.204012 --- ParallelTerminationStrategy: PID 20860 died... 16:08:15.223674 run iperf3-srv_10.42.42.10(pid=20860): Terminated {rc=256} 16:08:15.268373 --- ParallelTerminationStrategy: PID 20863 died... 16:08:15.287637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20863): Terminated: ok {rc=0} 16:08:15.334377 --- ParallelTerminationStrategy: PID 20866 died... 16:08:15.353808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20866): Terminated: ok {rc=0} 16:08:15.399416 --- ParallelTerminationStrategy: PID 20869 died... 16:08:15.418913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20869): Terminated: ok {rc=0} 16:08:15.507189 bus /gobi_0: Setting Powered False 16:08:16.635548 bus /gobi_0: Setting Powered False 16:08:17.792729 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 16:08:18.952391 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:18.966118 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:08:19.025443 tst iperf3.py: using LAC 22181 16:08:19.158941 tst iperf3.py: using RAC 251 16:08:19.289128 tst iperf3.py: using CellId 22181 16:08:19.420687 tst iperf3.py: using BVCI 22182 16:08:19.544616 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:19.557287 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:19.570995 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:19.583408 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:19.597461 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:19.611457 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:19.625062 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:19.638161 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:19.650493 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:19.777949 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:08:20.009929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:08:20.350926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20871): Launched 16:08:20.656198 run iperf3-srv_10.42.42.10(pid=20872): Launched 16:08:20.798353 tst iperf3.py:8: start network... 16:08:21.030499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:21.554323 run create_hlr_db(pid=20873): Launched 16:08:21.723975 bus /gobi_6: Setting Powered False 16:08:22.789392 run create_hlr_db(pid=20873): Terminated: ok {rc=0} 16:08:23.264192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20875): Launched 16:08:23.616175 run osmo-hlr_10.42.42.2(pid=20876): Launched 16:08:23.870930 run osmo-stp_10.42.42.5: Starting osmo-stp 16:08:24.542594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20878): Launched 16:08:24.849209 run osmo-stp_10.42.42.5(pid=20879): Launched 16:08:24.964772 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:08:25.492301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20881): Launched 16:08:25.610549 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:08:25.870050 run patchelf(pid=20882): Launched 16:08:26.042550 run osmo-stp_10.42.42.5(pid=20879): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20879)] 16:08:26.172543 run osmo-stp_10.42.42.5(pid=20879): stdout: | (launched: 2022-12-09_16:08:24.792811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:26.303869 run osmo-stp_10.42.42.5(pid=20879): stderr: | [0;m[38;5;43m20221209160824963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160824963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160824964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160824964 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160824964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160824965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160824965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:26.434750 run osmo-stp_10.42.42.5(pid=20879): stdout: | (launched: 2022-12-09_16:08:24.792811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:26.558929 run osmo-stp_10.42.42.5(pid=20879): stderr: | [0;m[38;5;43m20221209160824963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160824963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160824964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160824964 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160824964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160824965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160824965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:26.706220 run patchelf(pid=20882): Terminating (SIGINT) 16:08:26.877343 run patchelf(pid=20882): Terminated: ok {rc=0} 16:08:27.001246 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20879): Process ended prematurely: osmo-stp_10.42.42.5(pid=20879) [trial-2361↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20879)] [trial-2361↪gprs:trx-sysmocell5000↪iperf3.py:8] 16:08:27.010817 tst iperf3.py:8: Test FAILED (8.1 sec) 16:08:27.037988 run osmo-hlr_10.42.42.2(pid=20876): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20876)] 16:08:27.085573 run osmo-hlr_10.42.42.2(pid=20876): stdout: | (launched: 2022-12-09_16:08:23.552534) 16:08:27.135134 run osmo-hlr_10.42.42.2(pid=20876): stderr: | [0;m[1;31m20221209160823860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160823860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160823860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160823860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160823860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160823860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160823882 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160823890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160823890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160823890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:08:27.185132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20871): Terminating (SIGTERM) 16:08:27.225027 run iperf3-srv_10.42.42.10(pid=20872): Terminating (SIGTERM) 16:08:27.264416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20875): Terminating (SIGTERM) 16:08:27.304152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20878): Terminating (SIGTERM) 16:08:27.343849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20881): Terminating (SIGTERM) 16:08:27.383639 --- ParallelTerminationStrategy: PID 20871 died... 16:08:27.402763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20871): Terminated: ok {rc=0} 16:08:27.446633 --- ParallelTerminationStrategy: PID 20872 died... 16:08:27.465037 run iperf3-srv_10.42.42.10(pid=20872): Terminated {rc=256} 16:08:27.508592 --- ParallelTerminationStrategy: PID 20875 died... 16:08:27.527075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20875): Terminated: ok {rc=0} 16:08:27.570596 --- ParallelTerminationStrategy: PID 20878 died... 16:08:27.589155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20878): Terminated: ok {rc=0} 16:08:27.632646 --- ParallelTerminationStrategy: PID 20881 died... 16:08:27.651158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20881): Terminated: ok {rc=0} 16:08:27.734167 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 16:08:28.876733 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:28.888808 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:08:28.936920 tst iperf3m4.py: using LAC 22182 16:08:29.055078 tst iperf3m4.py: using RAC 252 16:08:29.174891 tst iperf3m4.py: using CellId 22182 16:08:29.295585 tst iperf3m4.py: using BVCI 22183 16:08:29.406773 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:29.417820 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:29.428512 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:29.439290 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:29.449922 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:29.460453 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:29.471326 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:29.481938 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:29.492654 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:29.613338 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:29.732733 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:29.853567 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:29.973365 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:08:30.195672 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:08:30.525194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20883): Launched 16:08:30.810437 run iperf3-srv_10.42.42.10(pid=20884): Launched 16:08:30.943665 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:08:31.156664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:08:31.474917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20885): Launched 16:08:31.763722 run iperf3-srv_10.42.42.10(pid=20886): Launched 16:08:31.907596 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:08:32.145766 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:08:32.455833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20887): Launched 16:08:32.722537 run iperf3-srv_10.42.42.10(pid=20888): Launched 16:08:32.837159 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:08:33.041849 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:08:33.349059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20889): Launched 16:08:33.615003 run iperf3-srv_10.42.42.10(pid=20890): Launched 16:08:33.729215 tst iperf3m4.py:8: start network... 16:08:33.934159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:34.409998 run create_hlr_db(pid=20891): Launched 16:08:34.534872 bus /gobi_6: Setting Powered False 16:08:35.595503 run create_hlr_db(pid=20891): Terminated: ok {rc=0} 16:08:36.022244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20893): Launched 16:08:36.330040 run osmo-hlr_10.42.42.2(pid=20894): Launched 16:08:36.447105 run osmo-stp_10.42.42.5: Starting osmo-stp 16:08:36.988823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20896): Launched 16:08:37.295532 run osmo-stp_10.42.42.5(pid=20897): Launched 16:08:37.411440 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:08:37.938193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20899): Launched 16:08:38.055671 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:08:38.315134 run patchelf(pid=20900): Launched 16:08:38.487795 run osmo-stp_10.42.42.5(pid=20897): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20897)] 16:08:38.619054 run osmo-stp_10.42.42.5(pid=20897): stdout: | (launched: 2022-12-09_16:08:37.239119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:38.751679 run osmo-stp_10.42.42.5(pid=20897): stderr: | [0;m[38;5;43m20221209160837407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160837407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160837408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160837408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160837409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160837409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160837409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:38.884275 run osmo-stp_10.42.42.5(pid=20897): stdout: | (launched: 2022-12-09_16:08:37.239119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:39.010455 run osmo-stp_10.42.42.5(pid=20897): stderr: | [0;m[38;5;43m20221209160837407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160837407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160837408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160837408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160837409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160837409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160837409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:39.159955 run patchelf(pid=20900): Terminating (SIGINT) 16:08:39.333517 run patchelf(pid=20900): Terminated: ok {rc=0} 16:08:39.458497 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20897): Process ended prematurely: osmo-stp_10.42.42.5(pid=20897) [trial-2361↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20897)] [trial-2361↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 16:08:39.467863 tst iperf3m4.py:8: Test FAILED (10.6 sec) 16:08:39.495221 run osmo-hlr_10.42.42.2(pid=20894): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20894)] 16:08:39.543479 run osmo-hlr_10.42.42.2(pid=20894): stdout: | (launched: 2022-12-09_16:08:36.272727) 16:08:39.592932 run osmo-hlr_10.42.42.2(pid=20894): stderr: | [0;m[1;31m20221209160836449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160836449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160836449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160836449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160836449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160836449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160836463 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160836472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160836472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160836472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:08:39.642814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20883): Terminating (SIGTERM) 16:08:39.682629 run iperf3-srv_10.42.42.10(pid=20884): Terminating (SIGTERM) 16:08:39.722482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20885): Terminating (SIGTERM) 16:08:39.762471 run iperf3-srv_10.42.42.10(pid=20886): Terminating (SIGTERM) 16:08:39.802204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20887): Terminating (SIGTERM) 16:08:39.842048 run iperf3-srv_10.42.42.10(pid=20888): Terminating (SIGTERM) 16:08:39.881685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20889): Terminating (SIGTERM) 16:08:39.921475 run iperf3-srv_10.42.42.10(pid=20890): Terminating (SIGTERM) 16:08:39.961171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20893): Terminating (SIGTERM) 16:08:40.000870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20896): Terminating (SIGTERM) 16:08:40.040713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20899): Terminating (SIGTERM) 16:08:40.080819 --- ParallelTerminationStrategy: PID 20883 died... 16:08:40.100027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20883): Terminated: ok {rc=0} 16:08:40.144391 --- ParallelTerminationStrategy: PID 20884 died... 16:08:40.163162 run iperf3-srv_10.42.42.10(pid=20884): Terminated {rc=256} 16:08:40.206943 --- ParallelTerminationStrategy: PID 20885 died... 16:08:40.225484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20885): Terminated: ok {rc=0} 16:08:40.269504 --- ParallelTerminationStrategy: PID 20886 died... 16:08:40.288193 run iperf3-srv_10.42.42.10(pid=20886): Terminated {rc=256} 16:08:40.332323 --- ParallelTerminationStrategy: PID 20887 died... 16:08:40.351163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20887): Terminated: ok {rc=0} 16:08:40.395213 --- ParallelTerminationStrategy: PID 20888 died... 16:08:40.413875 run iperf3-srv_10.42.42.10(pid=20888): Terminated {rc=256} 16:08:40.458345 --- ParallelTerminationStrategy: PID 20889 died... 16:08:40.477145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20889): Terminated: ok {rc=0} 16:08:40.521552 --- ParallelTerminationStrategy: PID 20890 died... 16:08:40.540292 run iperf3-srv_10.42.42.10(pid=20890): Terminated {rc=256} 16:08:40.585184 --- ParallelTerminationStrategy: PID 20893 died... 16:08:40.603626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20893): Terminated: ok {rc=0} 16:08:40.647567 --- ParallelTerminationStrategy: PID 20896 died... 16:08:40.666314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20896): Terminated: ok {rc=0} 16:08:40.710181 --- ParallelTerminationStrategy: PID 20899 died... 16:08:40.728751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20899): Terminated: ok {rc=0} 16:08:40.814176 bus /gobi_4: Setting Powered False 16:08:41.914377 bus /gobi_4: Setting Powered False 16:08:43.029733 bus /gobi_1: Setting Powered False 16:08:44.128418 bus /gobi_1: Setting Powered False 16:08:45.243507 bus /gobi_0: Setting Powered False 16:08:46.349062 bus /gobi_0: Setting Powered False 16:08:47.475157 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 16:08:48.576316 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:48.588002 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:08:48.637446 tst ping.py: using LAC 22183 16:08:48.757683 tst ping.py: using RAC 253 16:08:48.876156 tst ping.py: using CellId 22183 16:08:48.996022 tst ping.py: using BVCI 22184 16:08:49.117826 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:49.129367 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:49.140803 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:49.152628 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:49.164426 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:49.176015 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:49.187709 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:49.199447 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:49.316340 tst ping.py:19: start network... 16:08:49.521205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:49.989784 run create_hlr_db(pid=20902): Launched 16:08:50.113474 bus /gobi_6: Setting Powered False 16:08:51.174103 run create_hlr_db(pid=20902): Terminated: ok {rc=0} 16:08:51.616736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20904): Launched 16:08:51.942999 run osmo-hlr_10.42.42.2(pid=20905): Launched 16:08:52.066756 run osmo-stp_10.42.42.5: Starting osmo-stp 16:08:52.629374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20907): Launched 16:08:52.953016 run osmo-stp_10.42.42.5(pid=20908): Launched 16:08:53.078195 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:08:53.639139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20910): Launched 16:08:53.765315 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:08:54.039923 run patchelf(pid=20911): Launched 16:08:54.222967 run osmo-stp_10.42.42.5(pid=20908): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20908)] 16:08:54.361023 run osmo-stp_10.42.42.5(pid=20908): stdout: | (launched: 2022-12-09_16:08:52.893912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:54.501213 run osmo-stp_10.42.42.5(pid=20908): stderr: | [0;m[38;5;43m20221209160853086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160853086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160853087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160853087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160853087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160853088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160853088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:54.641695 run osmo-stp_10.42.42.5(pid=20908): stdout: | (launched: 2022-12-09_16:08:52.893912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:54.775589 run osmo-stp_10.42.42.5(pid=20908): stderr: | [0;m[38;5;43m20221209160853086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160853086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160853087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160853087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160853087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160853088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160853088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:54.934292 run patchelf(pid=20911): Terminating (SIGINT) 16:08:55.115845 run patchelf(pid=20911): Terminated: ok {rc=0} 16:08:55.246800 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20908): Process ended prematurely: osmo-stp_10.42.42.5(pid=20908) [trial-2361↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20908)] [trial-2361↪gprs:trx-sysmocell5000↪ping.py:22] 16:08:55.256273 tst ping.py:22: Test FAILED (6.7 sec) 16:08:55.285261 run osmo-hlr_10.42.42.2(pid=20905): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20905)] 16:08:55.336160 run osmo-hlr_10.42.42.2(pid=20905): stdout: | (launched: 2022-12-09_16:08:51.883648) 16:08:55.389091 run osmo-hlr_10.42.42.2(pid=20905): stderr: | [0;m[1;31m20221209160852082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160852082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160852082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160852082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160852082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160852082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160852094 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160852102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160852103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160852103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:08:55.442339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20904): Terminating (SIGTERM) 16:08:55.484821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20907): Terminating (SIGTERM) 16:08:55.527472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20910): Terminating (SIGTERM) 16:08:55.570467 --- ParallelTerminationStrategy: PID 20904 died... 16:08:55.590763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20904): Terminated: ok {rc=0} 16:08:55.638408 --- ParallelTerminationStrategy: PID 20907 died... 16:08:55.658381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20907): Terminated: ok {rc=0} 16:08:55.705653 --- ParallelTerminationStrategy: PID 20910 died... 16:08:55.725503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20910): Terminated: ok {rc=0} 16:08:55.814861 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 16:08:56.902911 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:56.915271 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:08:56.968920 tst ping_idle_ping.py: using LAC 22184 16:08:57.100663 tst ping_idle_ping.py: using RAC 254 16:08:57.227318 tst ping_idle_ping.py: using CellId 22184 16:08:57.351819 tst ping_idle_ping.py: using BVCI 22185 16:08:57.469228 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:57.480631 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:57.494865 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:57.505900 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:57.516754 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:57.527639 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:57.538653 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:08:57.549262 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:08:57.669293 tst ping_idle_ping.py:24: start network... 16:08:57.889932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:58.396672 run create_hlr_db(pid=20912): Launched 16:08:58.521453 bus /gobi_6: Setting Powered False 16:08:59.586328 run create_hlr_db(pid=20912): Terminated: ok {rc=0} 16:09:00.024083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20914): Launched 16:09:00.330819 run osmo-hlr_10.42.42.2(pid=20915): Launched 16:09:00.447586 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:01.025766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20917): Launched 16:09:01.345624 run osmo-stp_10.42.42.5(pid=20918): Launched 16:09:01.687556 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:09:02.364645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20920): Launched 16:09:02.480855 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:09:02.738900 run patchelf(pid=20921): Launched 16:09:02.910259 run osmo-stp_10.42.42.5(pid=20918): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20918)] 16:09:03.038841 run osmo-stp_10.42.42.5(pid=20918): stdout: | (launched: 2022-12-09_16:09:01.287671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:03.169832 run osmo-stp_10.42.42.5(pid=20918): stderr: | [0;m[38;5;43m20221209160901617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160901617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160901618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160901618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160901619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160901620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160901620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:03.300665 run osmo-stp_10.42.42.5(pid=20918): stdout: | (launched: 2022-12-09_16:09:01.287671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:03.424926 run osmo-stp_10.42.42.5(pid=20918): stderr: | [0;m[38;5;43m20221209160901617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160901617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160901618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160901618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160901619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160901620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160901620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:03.572336 run patchelf(pid=20921): Terminating (SIGINT) 16:09:03.742777 run patchelf(pid=20921): Terminated: ok {rc=0} 16:09:03.865567 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20918): Process ended prematurely: osmo-stp_10.42.42.5(pid=20918) [trial-2361↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20918)] [trial-2361↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 16:09:03.874464 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 16:09:03.901309 run osmo-hlr_10.42.42.2(pid=20915): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20915)] 16:09:03.949309 run osmo-hlr_10.42.42.2(pid=20915): stdout: | (launched: 2022-12-09_16:09:00.273888) 16:09:03.999047 run osmo-hlr_10.42.42.2(pid=20915): stderr: | [0;m[1;31m20221209160900449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160900449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160900449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160900449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160900449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160900449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160900461 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160900469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160900470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160900470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:04.049434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20914): Terminating (SIGTERM) 16:09:04.089486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20917): Terminating (SIGTERM) 16:09:04.129653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20920): Terminating (SIGTERM) 16:09:04.169957 --- ParallelTerminationStrategy: PID 20914 died... 16:09:04.189150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20914): Terminated: ok {rc=0} 16:09:04.233208 --- ParallelTerminationStrategy: PID 20917 died... 16:09:04.251941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20917): Terminated: ok {rc=0} 16:09:04.296341 --- ParallelTerminationStrategy: PID 20920 died... 16:09:04.315320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20920): Terminated: ok {rc=0} 16:09:04.401901 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 16:09:05.710706 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:09:05.716473 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:09:05.750237 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:09:05.788542 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:09:05.875313 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:09:05.908561 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:09:05.946664 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:09:06.542849 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:09:06.592396 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:06.603461 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:09:06.659177 tst cs_paging_gprs_active.py: using LAC 22185 16:09:06.779849 tst cs_paging_gprs_active.py: using RAC 255 16:09:06.900998 tst cs_paging_gprs_active.py: using CellId 22185 16:09:07.019596 tst cs_paging_gprs_active.py: using BVCI 22186 16:09:07.133519 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:07.144487 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:07.155411 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:07.166331 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:07.177623 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:07.188358 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:07.199345 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:07.210112 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:07.221053 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:07.341104 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:07.460608 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:09:07.669571 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:07.980092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20925): Launched 16:09:08.250539 run iperf3-srv_10.42.42.10(pid=20926): Launched 16:09:08.368412 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:09:08.576065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:08.886621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20927): Launched 16:09:09.158252 run iperf3-srv_10.42.42.10(pid=20928): Launched 16:09:09.274144 tst cs_paging_gprs_active.py:38: start network... 16:09:09.481435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:09.960016 run create_hlr_db(pid=20929): Launched 16:09:10.086509 bus /gobi_6: Setting Powered False 16:09:11.148112 run create_hlr_db(pid=20929): Terminated: ok {rc=0} 16:09:11.600397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20931): Launched 16:09:11.931951 run osmo-hlr_10.42.42.2(pid=20932): Launched 16:09:12.058787 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:12.628725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20934): Launched 16:09:12.959315 run osmo-stp_10.42.42.5(pid=20935): Launched 16:09:13.086840 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:09:13.658128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20937): Launched 16:09:13.786713 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:09:14.067387 run patchelf(pid=20938): Launched 16:09:14.252048 run osmo-stp_10.42.42.5(pid=20935): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20935)] 16:09:14.392234 run osmo-stp_10.42.42.5(pid=20935): stdout: | (launched: 2022-12-09_16:09:12.899222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:14.533815 run osmo-stp_10.42.42.5(pid=20935): stderr: | [0;m[38;5;43m20221209160913090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160913090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160913091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160913091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160913091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160913091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160913091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:14.676013 run osmo-stp_10.42.42.5(pid=20935): stdout: | (launched: 2022-12-09_16:09:12.899222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:14.811302 run osmo-stp_10.42.42.5(pid=20935): stderr: | [0;m[38;5;43m20221209160913090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160913090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160913091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160913091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160913091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160913091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160913091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:14.971642 run patchelf(pid=20938): Terminating (SIGINT) 16:09:15.157525 run patchelf(pid=20938): Terminated: ok {rc=0} 16:09:15.291589 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20935): Process ended prematurely: osmo-stp_10.42.42.5(pid=20935) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20935)] [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:09:15.302037 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:09:15.331432 run osmo-hlr_10.42.42.2(pid=20932): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20932)] 16:09:15.382093 run osmo-hlr_10.42.42.2(pid=20932): stdout: | (launched: 2022-12-09_16:09:11.871662) 16:09:15.434576 run osmo-hlr_10.42.42.2(pid=20932): stderr: | [0;m[1;31m20221209160912072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160912072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160912072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160912072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160912072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160912072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160912084 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160912092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160912092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160912092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:15.486876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20925): Terminating (SIGTERM) 16:09:15.529144 run iperf3-srv_10.42.42.10(pid=20926): Terminating (SIGTERM) 16:09:15.571250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20927): Terminating (SIGTERM) 16:09:15.613711 run iperf3-srv_10.42.42.10(pid=20928): Terminating (SIGTERM) 16:09:15.655799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20931): Terminating (SIGTERM) 16:09:15.698022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20934): Terminating (SIGTERM) 16:09:15.740317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20937): Terminating (SIGTERM) 16:09:15.782564 --- ParallelTerminationStrategy: PID 20925 died... 16:09:15.802489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20925): Terminated: ok {rc=0} 16:09:15.861786 --- ParallelTerminationStrategy: PID 20926 died... 16:09:15.888061 run iperf3-srv_10.42.42.10(pid=20926): Terminated {rc=256} 16:09:15.949259 --- ParallelTerminationStrategy: PID 20927 died... 16:09:15.969261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20927): Terminated: ok {rc=0} 16:09:16.017249 --- ParallelTerminationStrategy: PID 20928 died... 16:09:16.039812 run iperf3-srv_10.42.42.10(pid=20928): Terminated {rc=256} 16:09:16.100081 --- ParallelTerminationStrategy: PID 20931 died... 16:09:16.126111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20931): Terminated: ok {rc=0} 16:09:16.177156 --- ParallelTerminationStrategy: PID 20934 died... 16:09:16.196788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20934): Terminated: ok {rc=0} 16:09:16.243931 --- ParallelTerminationStrategy: PID 20937 died... 16:09:16.263643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20937): Terminated: ok {rc=0} 16:09:16.353942 bus /gobi_0: Setting Powered False 16:09:17.450780 bus /gobi_0: Setting Powered False 16:09:18.566413 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:09:19.718912 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:19.731410 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:09:19.788025 tst iperf3.py: using LAC 22186 16:09:19.917722 tst iperf3.py: using RAC 1 16:09:20.044474 tst iperf3.py: using CellId 22186 16:09:20.172900 tst iperf3.py: using BVCI 22187 16:09:20.284686 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:20.295933 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:20.306953 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:20.318015 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:20.328913 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:20.339937 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:20.350884 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:20.362287 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:20.373456 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:20.493342 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:09:20.716838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:21.047957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20939): Launched 16:09:21.335199 run iperf3-srv_10.42.42.10(pid=20940): Launched 16:09:21.460387 tst iperf3.py:8: start network... 16:09:21.683233 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:22.194347 run create_hlr_db(pid=20941): Launched 16:09:22.322264 bus /gobi_6: Setting Powered False 16:09:23.386479 run create_hlr_db(pid=20941): Terminated: ok {rc=0} 16:09:23.826411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20943): Launched 16:09:24.137281 run osmo-hlr_10.42.42.2(pid=20944): Launched 16:09:24.256683 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:24.789674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20946): Launched 16:09:25.098176 run osmo-stp_10.42.42.5(pid=20947): Launched 16:09:25.216182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:09:25.748461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20949): Launched 16:09:25.867224 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:09:26.128896 run patchelf(pid=20950): Launched 16:09:26.301104 run osmo-stp_10.42.42.5(pid=20947): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20947)] 16:09:26.433071 run osmo-stp_10.42.42.5(pid=20947): stdout: | (launched: 2022-12-09_16:09:25.041506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:26.565932 run osmo-stp_10.42.42.5(pid=20947): stderr: | [0;m[38;5;43m20221209160925215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160925215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160925215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160925215 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160925216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160925216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160925216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:26.699450 run osmo-stp_10.42.42.5(pid=20947): stdout: | (launched: 2022-12-09_16:09:25.041506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:26.826055 run osmo-stp_10.42.42.5(pid=20947): stderr: | [0;m[38;5;43m20221209160925215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160925215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160925215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160925215 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160925216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160925216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160925216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:26.975956 run patchelf(pid=20950): Terminating (SIGINT) 16:09:27.149990 run patchelf(pid=20950): Terminated: ok {rc=0} 16:09:27.275475 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20947): Process ended prematurely: osmo-stp_10.42.42.5(pid=20947) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20947)] [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 16:09:27.285625 tst iperf3.py:8: Test FAILED (7.6 sec) 16:09:27.312841 run osmo-hlr_10.42.42.2(pid=20944): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20944)] 16:09:27.360835 run osmo-hlr_10.42.42.2(pid=20944): stdout: | (launched: 2022-12-09_16:09:24.080192) 16:09:27.410639 run osmo-hlr_10.42.42.2(pid=20944): stderr: | [0;m[1;31m20221209160924257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160924257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160924257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160924257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160924257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160924257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160924269 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160924277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160924278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160924278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:27.460753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20939): Terminating (SIGTERM) 16:09:27.501074 run iperf3-srv_10.42.42.10(pid=20940): Terminating (SIGTERM) 16:09:27.541332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20943): Terminating (SIGTERM) 16:09:27.581417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20946): Terminating (SIGTERM) 16:09:27.622206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20949): Terminating (SIGTERM) 16:09:27.662405 --- ParallelTerminationStrategy: PID 20939 died... 16:09:27.681658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20939): Terminated: ok {rc=0} 16:09:27.726049 --- ParallelTerminationStrategy: PID 20940 died... 16:09:27.744851 run iperf3-srv_10.42.42.10(pid=20940): Terminated {rc=256} 16:09:27.788809 --- ParallelTerminationStrategy: PID 20943 died... 16:09:27.807953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20943): Terminated: ok {rc=0} 16:09:27.852175 --- ParallelTerminationStrategy: PID 20946 died... 16:09:27.870914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20946): Terminated: ok {rc=0} 16:09:27.914817 --- ParallelTerminationStrategy: PID 20949 died... 16:09:27.933664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20949): Terminated: ok {rc=0} 16:09:28.019945 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:09:29.168823 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:29.180789 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:09:29.233024 tst iperf3m4.py: using LAC 22187 16:09:29.355392 tst iperf3m4.py: using RAC 2 16:09:29.477728 tst iperf3m4.py: using CellId 22187 16:09:29.600644 tst iperf3m4.py: using BVCI 22188 16:09:29.713328 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:29.724438 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:29.735333 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:29.746295 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:29.757049 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:29.767815 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:29.778795 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:29.789607 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:29.800519 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:29.922072 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:30.046656 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:30.165178 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:30.284201 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:09:30.492755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:30.804560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20951): Launched 16:09:31.114855 run iperf3-srv_10.42.42.10(pid=20952): Launched 16:09:31.256764 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:09:31.490252 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:31.871038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20953): Launched 16:09:32.180808 run iperf3-srv_10.42.42.10(pid=20954): Launched 16:09:32.319672 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:09:32.544872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:32.879124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20955): Launched 16:09:33.169573 run iperf3-srv_10.42.42.10(pid=20956): Launched 16:09:33.294358 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:09:33.518501 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:09:33.850628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20957): Launched 16:09:34.139984 run iperf3-srv_10.42.42.10(pid=20958): Launched 16:09:34.264764 tst iperf3m4.py:8: start network... 16:09:34.489258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:35.003007 run create_hlr_db(pid=20959): Launched 16:09:35.130731 bus /gobi_6: Setting Powered False 16:09:36.195288 run create_hlr_db(pid=20959): Terminated: ok {rc=0} 16:09:36.656516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20961): Launched 16:09:36.988293 run osmo-hlr_10.42.42.2(pid=20962): Launched 16:09:37.117825 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:37.691705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20964): Launched 16:09:38.026768 run osmo-stp_10.42.42.5(pid=20965): Launched 16:09:38.155920 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:09:38.727004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20967): Launched 16:09:38.856760 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:09:39.137781 run patchelf(pid=20968): Launched 16:09:39.323632 run osmo-stp_10.42.42.5(pid=20965): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20965)] 16:09:39.463662 run osmo-stp_10.42.42.5(pid=20965): stdout: | (launched: 2022-12-09_16:09:37.966040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:39.604764 run osmo-stp_10.42.42.5(pid=20965): stderr: | [0;m[38;5;43m20221209160938156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160938156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160938156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160938157 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160938157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160938158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160938158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:39.746450 run osmo-stp_10.42.42.5(pid=20965): stdout: | (launched: 2022-12-09_16:09:37.966040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:39.881639 run osmo-stp_10.42.42.5(pid=20965): stderr: | [0;m[38;5;43m20221209160938156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160938156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160938156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160938157 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160938157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160938158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160938158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:40.042238 run patchelf(pid=20968): Terminating (SIGINT) 16:09:40.228116 run patchelf(pid=20968): Terminated: ok {rc=0} 16:09:40.361829 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20965): Process ended prematurely: osmo-stp_10.42.42.5(pid=20965) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20965)] [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 16:09:40.372124 tst iperf3m4.py:8: Test FAILED (11.2 sec) 16:09:40.401785 run osmo-hlr_10.42.42.2(pid=20962): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20962)] 16:09:40.452456 run osmo-hlr_10.42.42.2(pid=20962): stdout: | (launched: 2022-12-09_16:09:36.927481) 16:09:40.505242 run osmo-hlr_10.42.42.2(pid=20962): stderr: | [0;m[1;31m20221209160937124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160937124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160937124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160937124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160937124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160937124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160937136 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160937144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160937144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160937145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:40.558418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20951): Terminating (SIGTERM) 16:09:40.600842 run iperf3-srv_10.42.42.10(pid=20952): Terminating (SIGTERM) 16:09:40.643469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20953): Terminating (SIGTERM) 16:09:40.685786 run iperf3-srv_10.42.42.10(pid=20954): Terminating (SIGTERM) 16:09:40.728100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20955): Terminating (SIGTERM) 16:09:40.770642 run iperf3-srv_10.42.42.10(pid=20956): Terminating (SIGTERM) 16:09:40.812858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20957): Terminating (SIGTERM) 16:09:40.855412 run iperf3-srv_10.42.42.10(pid=20958): Terminating (SIGTERM) 16:09:40.897989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20961): Terminating (SIGTERM) 16:09:40.940664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20964): Terminating (SIGTERM) 16:09:40.983186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20967): Terminating (SIGTERM) 16:09:41.025864 --- ParallelTerminationStrategy: PID 20951 died... 16:09:41.046115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20951): Terminated: ok {rc=0} 16:09:41.093413 --- ParallelTerminationStrategy: PID 20952 died... 16:09:41.113148 run iperf3-srv_10.42.42.10(pid=20952): Terminated {rc=256} 16:09:41.160285 --- ParallelTerminationStrategy: PID 20953 died... 16:09:41.179981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20953): Terminated: ok {rc=0} 16:09:41.226864 --- ParallelTerminationStrategy: PID 20954 died... 16:09:41.246608 run iperf3-srv_10.42.42.10(pid=20954): Terminated {rc=256} 16:09:41.293399 --- ParallelTerminationStrategy: PID 20955 died... 16:09:41.313193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20955): Terminated: ok {rc=0} 16:09:41.360278 --- ParallelTerminationStrategy: PID 20956 died... 16:09:41.380181 run iperf3-srv_10.42.42.10(pid=20956): Terminated {rc=256} 16:09:41.427035 --- ParallelTerminationStrategy: PID 20957 died... 16:09:41.446761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20957): Terminated: ok {rc=0} 16:09:41.494196 --- ParallelTerminationStrategy: PID 20958 died... 16:09:41.514103 run iperf3-srv_10.42.42.10(pid=20958): Terminated {rc=256} 16:09:41.561070 --- ParallelTerminationStrategy: PID 20961 died... 16:09:41.580822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20961): Terminated: ok {rc=0} 16:09:41.627875 --- ParallelTerminationStrategy: PID 20964 died... 16:09:41.647696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20964): Terminated: ok {rc=0} 16:09:41.694563 --- ParallelTerminationStrategy: PID 20967 died... 16:09:41.714394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20967): Terminated: ok {rc=0} 16:09:41.803609 bus /gobi_4: Setting Powered False 16:09:42.903974 bus /gobi_4: Setting Powered False 16:09:44.021717 bus /gobi_1: Setting Powered False 16:09:45.121080 bus /gobi_1: Setting Powered False 16:09:46.253269 bus /gobi_0: Setting Powered False 16:09:47.366846 bus /gobi_0: Setting Powered False 16:09:48.483406 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 16:09:49.587931 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:49.599810 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:09:49.656097 tst ping.py: using LAC 22188 16:09:49.775701 tst ping.py: using RAC 3 16:09:49.892136 tst ping.py: using CellId 22188 16:09:50.009190 tst ping.py: using BVCI 22189 16:09:50.118333 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:50.129539 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:50.140545 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:50.151534 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:50.162454 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:50.173316 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:50.184357 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:50.195281 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:50.315066 tst ping.py:19: start network... 16:09:50.534521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:51.035375 run create_hlr_db(pid=20969): Launched 16:09:51.160075 bus /gobi_6: Setting Powered False 16:09:52.224592 run create_hlr_db(pid=20969): Terminated: ok {rc=0} 16:09:52.660264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20971): Launched 16:09:52.965659 run osmo-hlr_10.42.42.2(pid=20972): Launched 16:09:53.081354 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:53.623371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20974): Launched 16:09:53.926505 run osmo-stp_10.42.42.5(pid=20975): Launched 16:09:54.043169 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:09:54.566375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20977): Launched 16:09:54.681978 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:09:54.939142 run patchelf(pid=20978): Launched 16:09:55.108125 run osmo-stp_10.42.42.5(pid=20975): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20975)] 16:09:55.236495 run osmo-stp_10.42.42.5(pid=20975): stdout: | (launched: 2022-12-09_16:09:53.870568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:55.366479 run osmo-stp_10.42.42.5(pid=20975): stderr: | [0;m[38;5;43m20221209160954040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160954040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160954041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160954041 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160954042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160954042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160954042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:55.496691 run osmo-stp_10.42.42.5(pid=20975): stdout: | (launched: 2022-12-09_16:09:53.870568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:55.620579 run osmo-stp_10.42.42.5(pid=20975): stderr: | [0;m[38;5;43m20221209160954040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209160954040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209160954041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209160954041 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209160954042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209160954042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209160954042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:55.767608 run patchelf(pid=20978): Terminating (SIGINT) 16:09:55.937859 run patchelf(pid=20978): Terminated: ok {rc=0} 16:09:56.060375 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20975): Process ended prematurely: osmo-stp_10.42.42.5(pid=20975) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20975)] [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 16:09:56.069311 tst ping.py:22: Test FAILED (6.5 sec) 16:09:56.096231 run osmo-hlr_10.42.42.2(pid=20972): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20972)] 16:09:56.144078 run osmo-hlr_10.42.42.2(pid=20972): stdout: | (launched: 2022-12-09_16:09:52.909301) 16:09:56.193230 run osmo-hlr_10.42.42.2(pid=20972): stderr: | [0;m[1;31m20221209160953085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209160953085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209160953085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209160953085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209160953086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209160953086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209160953098 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209160953110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209160953110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209160953110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:56.242887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20971): Terminating (SIGTERM) 16:09:56.283121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20974): Terminating (SIGTERM) 16:09:56.323004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20977): Terminating (SIGTERM) 16:09:56.363320 --- ParallelTerminationStrategy: PID 20971 died... 16:09:56.382232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20971): Terminated: ok {rc=0} 16:09:56.426642 --- ParallelTerminationStrategy: PID 20974 died... 16:09:56.445538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20974): Terminated: ok {rc=0} 16:09:56.489671 --- ParallelTerminationStrategy: PID 20977 died... 16:09:56.508508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20977): Terminated: ok {rc=0} 16:09:56.595060 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:09:57.683603 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:57.695576 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:09:57.747916 tst ping_idle_ping.py: using LAC 22189 16:09:57.866177 tst ping_idle_ping.py: using RAC 4 16:09:57.985724 tst ping_idle_ping.py: using CellId 22189 16:09:58.103388 tst ping_idle_ping.py: using BVCI 22190 16:09:58.214080 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:58.225297 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:58.236177 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:58.247043 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:58.257856 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:58.268619 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:58.279770 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:09:58.290617 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:09:58.410591 tst ping_idle_ping.py:24: start network... 16:09:58.632016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:59.139779 run create_hlr_db(pid=20980): Launched 16:09:59.267039 bus /gobi_6: Setting Powered False 16:10:00.331379 run create_hlr_db(pid=20980): Terminated: ok {rc=0} 16:10:00.770504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20982): Launched 16:10:01.105577 run osmo-hlr_10.42.42.2(pid=20983): Launched 16:10:01.307675 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:02.011278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20988): Launched 16:10:02.335395 run osmo-stp_10.42.42.5(pid=20989): Launched 16:10:02.451284 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:10:02.992043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20991): Launched 16:10:03.109333 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:10:03.367417 run patchelf(pid=20992): Launched 16:10:03.536941 run osmo-stp_10.42.42.5(pid=20989): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20989)] 16:10:03.665452 run osmo-stp_10.42.42.5(pid=20989): stdout: | (launched: 2022-12-09_16:10:02.279177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:03.796078 run osmo-stp_10.42.42.5(pid=20989): stderr: | [0;m[38;5;43m20221209161002448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161002448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161002449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161002449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161002450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161002450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161002450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:03.926597 run osmo-stp_10.42.42.5(pid=20989): stdout: | (launched: 2022-12-09_16:10:02.279177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:04.050897 run osmo-stp_10.42.42.5(pid=20989): stderr: | [0;m[38;5;43m20221209161002448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161002448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161002449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161002449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161002450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161002450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161002450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:04.198588 run patchelf(pid=20992): Terminating (SIGINT) 16:10:04.368271 run patchelf(pid=20992): Terminated: ok {rc=0} 16:10:04.491175 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20989): Process ended prematurely: osmo-stp_10.42.42.5(pid=20989) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20989)] [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 16:10:04.499944 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 16:10:04.526931 run osmo-hlr_10.42.42.2(pid=20983): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20983)] 16:10:04.574660 run osmo-hlr_10.42.42.2(pid=20983): stdout: | (launched: 2022-12-09_16:10:01.043345) 16:10:04.624067 run osmo-hlr_10.42.42.2(pid=20983): stderr: | [0;m[1;31m20221209161001398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161001398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161001398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161001398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161001398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161001398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161001423 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161001439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161001439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161001439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:04.673909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20982): Terminating (SIGTERM) 16:10:04.713887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20988): Terminating (SIGTERM) 16:10:04.753764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20991): Terminating (SIGTERM) 16:10:04.793889 --- ParallelTerminationStrategy: PID 20982 died... 16:10:04.813268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20982): Terminated: ok {rc=0} 16:10:04.857442 --- ParallelTerminationStrategy: PID 20988 died... 16:10:04.875948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20988): Terminated: ok {rc=0} 16:10:04.920464 --- ParallelTerminationStrategy: PID 20991 died... 16:10:04.939429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20991): Terminated: ok {rc=0} 16:10:05.027825 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:10:06.343563 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:10:06.349941 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:10:06.384684 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:10:06.423231 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:10:06.510831 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:10:06.544494 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:10:06.583101 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:10:07.179112 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:10:07.228230 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:07.239395 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:10:07.309881 tst cs_paging_gprs_active.py: using LAC 22190 16:10:07.432474 tst cs_paging_gprs_active.py: using RAC 5 16:10:07.555326 tst cs_paging_gprs_active.py: using CellId 22190 16:10:07.677589 tst cs_paging_gprs_active.py: using BVCI 22191 16:10:07.788895 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:07.800015 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:07.810927 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:07.821907 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:07.832709 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:07.843618 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:07.854943 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:07.865691 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:07.876707 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:07.996084 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:08.115683 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:10:08.322991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:08.633617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20997): Launched 16:10:08.902743 run iperf3-srv_10.42.42.10(pid=20998): Launched 16:10:09.021298 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:10:09.229651 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:09.540278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20999): Launched 16:10:09.810653 run iperf3-srv_10.42.42.10(pid=21000): Launched 16:10:09.926514 tst cs_paging_gprs_active.py:38: start network... 16:10:10.134196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:10.613045 run create_hlr_db(pid=21001): Launched 16:10:10.740608 bus /gobi_6: Setting Powered False 16:10:11.801882 run create_hlr_db(pid=21001): Terminated: ok {rc=0} 16:10:12.254764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21003): Launched 16:10:12.587216 run osmo-hlr_10.42.42.2(pid=21004): Launched 16:10:12.713925 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:13.284235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21006): Launched 16:10:13.616524 run osmo-stp_10.42.42.5(pid=21007): Launched 16:10:13.744660 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:10:14.315228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21009): Launched 16:10:14.442806 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:10:14.722866 run patchelf(pid=21010): Launched 16:10:14.908159 run osmo-stp_10.42.42.5(pid=21007): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21007)] 16:10:15.048516 run osmo-stp_10.42.42.5(pid=21007): stdout: | (launched: 2022-12-09_16:10:13.556029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:15.190523 run osmo-stp_10.42.42.5(pid=21007): stderr: | [0;m[38;5;43m20221209161013748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161013748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161013748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161013749 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161013749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161013749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161013750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:15.332450 run osmo-stp_10.42.42.5(pid=21007): stdout: | (launched: 2022-12-09_16:10:13.556029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:15.467453 run osmo-stp_10.42.42.5(pid=21007): stderr: | [0;m[38;5;43m20221209161013748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161013748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161013748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161013749 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161013749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161013749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161013750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:15.627719 run patchelf(pid=21010): Terminating (SIGINT) 16:10:15.812721 run patchelf(pid=21010): Terminated: ok {rc=0} 16:10:15.975439 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21007): Process ended prematurely: osmo-stp_10.42.42.5(pid=21007) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21007)] [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:10:15.987076 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 16:10:16.026598 run osmo-hlr_10.42.42.2(pid=21004): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21004)] 16:10:16.093160 run osmo-hlr_10.42.42.2(pid=21004): stdout: | (launched: 2022-12-09_16:10:12.526976) 16:10:16.146454 run osmo-hlr_10.42.42.2(pid=21004): stderr: | [0;m[1;31m20221209161012726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161012726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161012726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161012726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161012726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161012726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161012740 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161012750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161012750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161012750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:16.197950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20997): Terminating (SIGTERM) 16:10:16.239354 run iperf3-srv_10.42.42.10(pid=20998): Terminating (SIGTERM) 16:10:16.281623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20999): Terminating (SIGTERM) 16:10:16.324216 run iperf3-srv_10.42.42.10(pid=21000): Terminating (SIGTERM) 16:10:16.364995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21003): Terminating (SIGTERM) 16:10:16.406101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21006): Terminating (SIGTERM) 16:10:16.449353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21009): Terminating (SIGTERM) 16:10:16.492525 --- ParallelTerminationStrategy: PID 20997 died... 16:10:16.513645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20997): Terminated: ok {rc=0} 16:10:16.560788 --- ParallelTerminationStrategy: PID 20998 died... 16:10:16.580209 run iperf3-srv_10.42.42.10(pid=20998): Terminated {rc=256} 16:10:16.626602 --- ParallelTerminationStrategy: PID 20999 died... 16:10:16.646361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20999): Terminated: ok {rc=0} 16:10:16.693349 --- ParallelTerminationStrategy: PID 21000 died... 16:10:16.713715 run iperf3-srv_10.42.42.10(pid=21000): Terminated {rc=256} 16:10:16.758860 --- ParallelTerminationStrategy: PID 21003 died... 16:10:16.778679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21003): Terminated: ok {rc=0} 16:10:16.826632 --- ParallelTerminationStrategy: PID 21006 died... 16:10:16.846956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21006): Terminated: ok {rc=0} 16:10:16.894568 --- ParallelTerminationStrategy: PID 21009 died... 16:10:16.915372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21009): Terminated: ok {rc=0} 16:10:17.004811 bus /gobi_0: Setting Powered False 16:10:18.107410 bus /gobi_0: Setting Powered False 16:10:19.224817 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:10:20.375904 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:20.388422 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:10:20.465387 tst iperf3.py: using LAC 22191 16:10:20.598644 tst iperf3.py: using RAC 6 16:10:20.725752 tst iperf3.py: using CellId 22191 16:10:20.852321 tst iperf3.py: using BVCI 22192 16:10:20.971572 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:20.983217 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:20.994648 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:21.006122 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:21.018113 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:21.029824 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:21.041615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:21.053103 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:21.064894 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:21.185916 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:10:21.411119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:21.742961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21011): Launched 16:10:22.033308 run iperf3-srv_10.42.42.10(pid=21012): Launched 16:10:22.158317 tst iperf3.py:8: start network... 16:10:22.383092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:22.896468 run create_hlr_db(pid=21013): Launched 16:10:23.024035 bus /gobi_6: Setting Powered False 16:10:24.088940 run create_hlr_db(pid=21013): Terminated: ok {rc=0} 16:10:24.532460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21015): Launched 16:10:24.844107 run osmo-hlr_10.42.42.2(pid=21016): Launched 16:10:24.963561 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:25.514514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21018): Launched 16:10:25.825601 run osmo-stp_10.42.42.5(pid=21019): Launched 16:10:25.942360 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:10:26.480056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21021): Launched 16:10:26.599508 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:10:26.861901 run patchelf(pid=21022): Launched 16:10:27.034758 run osmo-stp_10.42.42.5(pid=21019): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21019)] 16:10:27.166536 run osmo-stp_10.42.42.5(pid=21019): stdout: | (launched: 2022-12-09_16:10:25.767746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:27.300054 run osmo-stp_10.42.42.5(pid=21019): stderr: | [0;m[38;5;43m20221209161025942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161025942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161025943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161025943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161025943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161025944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161025944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:27.432942 run osmo-stp_10.42.42.5(pid=21019): stdout: | (launched: 2022-12-09_16:10:25.767746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:27.559786 run osmo-stp_10.42.42.5(pid=21019): stderr: | [0;m[38;5;43m20221209161025942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161025942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161025943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161025943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161025943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161025944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161025944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:27.709420 run patchelf(pid=21022): Terminating (SIGINT) 16:10:27.883426 run patchelf(pid=21022): Terminated: ok {rc=0} 16:10:28.009247 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21019): Process ended prematurely: osmo-stp_10.42.42.5(pid=21019) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21019)] [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 16:10:28.018749 tst iperf3.py:8: Test FAILED (7.7 sec) 16:10:28.045967 run osmo-hlr_10.42.42.2(pid=21016): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21016)] 16:10:28.093644 run osmo-hlr_10.42.42.2(pid=21016): stdout: | (launched: 2022-12-09_16:10:24.787063) 16:10:28.143194 run osmo-hlr_10.42.42.2(pid=21016): stderr: | [0;m[1;31m20221209161024966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161024966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161024966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161024966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161024966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161024966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161024977 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161024985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161024986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161024986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:28.193896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21011): Terminating (SIGTERM) 16:10:28.233728 run iperf3-srv_10.42.42.10(pid=21012): Terminating (SIGTERM) 16:10:28.273463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21015): Terminating (SIGTERM) 16:10:28.313200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21018): Terminating (SIGTERM) 16:10:28.352827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21021): Terminating (SIGTERM) 16:10:28.392723 --- ParallelTerminationStrategy: PID 21011 died... 16:10:28.411820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21011): Terminated: ok {rc=0} 16:10:28.456134 --- ParallelTerminationStrategy: PID 21012 died... 16:10:28.474585 run iperf3-srv_10.42.42.10(pid=21012): Terminated {rc=256} 16:10:28.518275 --- ParallelTerminationStrategy: PID 21015 died... 16:10:28.537022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21015): Terminated: ok {rc=0} 16:10:28.580657 --- ParallelTerminationStrategy: PID 21018 died... 16:10:28.599369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21018): Terminated: ok {rc=0} 16:10:28.643510 --- ParallelTerminationStrategy: PID 21021 died... 16:10:28.662450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21021): Terminated: ok {rc=0} 16:10:28.750008 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:10:29.899287 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:29.911263 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:10:29.986986 tst iperf3m4.py: using LAC 22192 16:10:30.106418 tst iperf3m4.py: using RAC 7 16:10:30.226727 tst iperf3m4.py: using CellId 22192 16:10:30.360379 tst iperf3m4.py: using BVCI 22193 16:10:30.480607 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:30.492488 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:30.504036 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:30.516415 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:30.528830 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:30.541282 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:30.553906 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:30.567173 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:30.579717 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:30.703200 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:30.824801 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:30.962409 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:31.085472 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:10:31.316709 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:31.661757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21023): Launched 16:10:31.956474 run iperf3-srv_10.42.42.10(pid=21024): Launched 16:10:32.086692 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:10:32.316260 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:32.651003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21025): Launched 16:10:32.941030 run iperf3-srv_10.42.42.10(pid=21026): Launched 16:10:33.065932 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:10:33.291685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:33.626193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21027): Launched 16:10:33.916106 run iperf3-srv_10.42.42.10(pid=21028): Launched 16:10:34.041728 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:10:34.268063 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:10:34.602447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21029): Launched 16:10:34.891506 run iperf3-srv_10.42.42.10(pid=21030): Launched 16:10:35.017898 tst iperf3m4.py:8: start network... 16:10:35.244132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:35.758167 run create_hlr_db(pid=21031): Launched 16:10:35.886516 bus /gobi_6: Setting Powered False 16:10:36.951119 run create_hlr_db(pid=21031): Terminated: ok {rc=0} 16:10:37.412855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21033): Launched 16:10:37.746404 run osmo-hlr_10.42.42.2(pid=21034): Launched 16:10:37.875151 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:38.447087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21036): Launched 16:10:38.778138 run osmo-stp_10.42.42.5(pid=21037): Launched 16:10:38.905858 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:10:39.477399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21039): Launched 16:10:39.605414 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:10:39.883874 run patchelf(pid=21040): Launched 16:10:40.069739 run osmo-stp_10.42.42.5(pid=21037): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21037)] 16:10:40.210339 run osmo-stp_10.42.42.5(pid=21037): stdout: | (launched: 2022-12-09_16:10:38.717729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:40.352069 run osmo-stp_10.42.42.5(pid=21037): stderr: | [0;m[38;5;43m20221209161038907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161038907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161038908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161038908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161038908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161038909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161038909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:40.493798 run osmo-stp_10.42.42.5(pid=21037): stdout: | (launched: 2022-12-09_16:10:38.717729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:40.629193 run osmo-stp_10.42.42.5(pid=21037): stderr: | [0;m[38;5;43m20221209161038907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161038907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161038908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161038908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161038908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161038909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161038909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:40.789273 run patchelf(pid=21040): Terminating (SIGINT) 16:10:40.974017 run patchelf(pid=21040): Terminated: ok {rc=0} 16:10:41.107339 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21037): Process ended prematurely: osmo-stp_10.42.42.5(pid=21037) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21037)] [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:10:41.117748 tst iperf3m4.py:8: Test FAILED (11.3 sec) 16:10:41.147703 run osmo-hlr_10.42.42.2(pid=21034): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21034)] 16:10:41.198275 run osmo-hlr_10.42.42.2(pid=21034): stdout: | (launched: 2022-12-09_16:10:37.685779) 16:10:41.250669 run osmo-hlr_10.42.42.2(pid=21034): stderr: | [0;m[1;31m20221209161037882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161037882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161037882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161037882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161037882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161037882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161037894 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161037902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161037903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161037903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:41.303269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21023): Terminating (SIGTERM) 16:10:41.345456 run iperf3-srv_10.42.42.10(pid=21024): Terminating (SIGTERM) 16:10:41.387681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21025): Terminating (SIGTERM) 16:10:41.429830 run iperf3-srv_10.42.42.10(pid=21026): Terminating (SIGTERM) 16:10:41.471870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21027): Terminating (SIGTERM) 16:10:41.513957 run iperf3-srv_10.42.42.10(pid=21028): Terminating (SIGTERM) 16:10:41.555738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21029): Terminating (SIGTERM) 16:10:41.597708 run iperf3-srv_10.42.42.10(pid=21030): Terminating (SIGTERM) 16:10:41.639530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21033): Terminating (SIGTERM) 16:10:41.681513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21036): Terminating (SIGTERM) 16:10:41.723272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21039): Terminating (SIGTERM) 16:10:41.765370 --- ParallelTerminationStrategy: PID 21023 died... 16:10:41.784755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21023): Terminated: ok {rc=0} 16:10:41.831412 --- ParallelTerminationStrategy: PID 21024 died... 16:10:41.850954 run iperf3-srv_10.42.42.10(pid=21024): Terminated {rc=256} 16:10:41.897442 --- ParallelTerminationStrategy: PID 21025 died... 16:10:41.917404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21025): Terminated: ok {rc=0} 16:10:41.964587 --- ParallelTerminationStrategy: PID 21026 died... 16:10:41.984102 run iperf3-srv_10.42.42.10(pid=21026): Terminated {rc=256} 16:10:42.030433 --- ParallelTerminationStrategy: PID 21027 died... 16:10:42.049964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21027): Terminated: ok {rc=0} 16:10:42.096659 --- ParallelTerminationStrategy: PID 21028 died... 16:10:42.116146 run iperf3-srv_10.42.42.10(pid=21028): Terminated {rc=256} 16:10:42.162698 --- ParallelTerminationStrategy: PID 21029 died... 16:10:42.182155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21029): Terminated: ok {rc=0} 16:10:42.228760 --- ParallelTerminationStrategy: PID 21030 died... 16:10:42.248224 run iperf3-srv_10.42.42.10(pid=21030): Terminated {rc=256} 16:10:42.294343 --- ParallelTerminationStrategy: PID 21033 died... 16:10:42.313772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21033): Terminated: ok {rc=0} 16:10:42.360064 --- ParallelTerminationStrategy: PID 21036 died... 16:10:42.379572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21036): Terminated: ok {rc=0} 16:10:42.425860 --- ParallelTerminationStrategy: PID 21039 died... 16:10:42.445334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21039): Terminated: ok {rc=0} 16:10:42.533660 bus /gobi_4: Setting Powered False 16:10:43.633719 bus /gobi_4: Setting Powered False 16:10:44.750034 bus /gobi_1: Setting Powered False 16:10:45.850970 bus /gobi_1: Setting Powered False 16:10:46.988816 bus /gobi_0: Setting Powered False 16:10:48.086259 bus /gobi_0: Setting Powered False 16:10:49.201720 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:10:50.305613 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:50.318207 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:10:50.391709 tst ping.py: using LAC 22193 16:10:50.518861 tst ping.py: using RAC 8 16:10:50.637450 tst ping.py: using CellId 22193 16:10:50.757498 tst ping.py: using BVCI 22194 16:10:50.869537 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:50.880815 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:50.892037 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:50.903402 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:50.914654 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:50.925849 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:50.937055 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:50.948093 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:51.068836 tst ping.py:19: start network... 16:10:51.289731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:51.790379 run create_hlr_db(pid=21041): Launched 16:10:51.915588 bus /gobi_6: Setting Powered False 16:10:52.979392 run create_hlr_db(pid=21041): Terminated: ok {rc=0} 16:10:53.415101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21043): Launched 16:10:53.719577 run osmo-hlr_10.42.42.2(pid=21044): Launched 16:10:53.836409 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:54.366370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21046): Launched 16:10:54.670597 run osmo-stp_10.42.42.5(pid=21047): Launched 16:10:54.785454 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:10:55.312060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21049): Launched 16:10:55.428414 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:10:55.685971 run patchelf(pid=21050): Launched 16:10:55.855428 run osmo-stp_10.42.42.5(pid=21047): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21047)] 16:10:55.983400 run osmo-stp_10.42.42.5(pid=21047): stdout: | (launched: 2022-12-09_16:10:54.613685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:56.114324 run osmo-stp_10.42.42.5(pid=21047): stderr: | [0;m[38;5;43m20221209161054785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161054785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161054785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161054786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161054786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161054786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161054786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:56.244407 run osmo-stp_10.42.42.5(pid=21047): stdout: | (launched: 2022-12-09_16:10:54.613685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:56.368867 run osmo-stp_10.42.42.5(pid=21047): stderr: | [0;m[38;5;43m20221209161054785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161054785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161054785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161054786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161054786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161054786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161054786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:56.515716 run patchelf(pid=21050): Terminating (SIGINT) 16:10:56.685157 run patchelf(pid=21050): Terminated: ok {rc=0} 16:10:56.807655 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21047): Process ended prematurely: osmo-stp_10.42.42.5(pid=21047) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21047)] [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 16:10:56.816827 tst ping.py:22: Test FAILED (6.5 sec) 16:10:56.844115 run osmo-hlr_10.42.42.2(pid=21044): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21044)] 16:10:56.892312 run osmo-hlr_10.42.42.2(pid=21044): stdout: | (launched: 2022-12-09_16:10:53.662996) 16:10:56.942276 run osmo-hlr_10.42.42.2(pid=21044): stderr: | [0;m[1;31m20221209161053838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161053838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161053838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161053839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161053839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161053839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161053851 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161053862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161053862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161053862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:56.992538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21043): Terminating (SIGTERM) 16:10:57.032918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21046): Terminating (SIGTERM) 16:10:57.073769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21049): Terminating (SIGTERM) 16:10:57.114640 --- ParallelTerminationStrategy: PID 21043 died... 16:10:57.133751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21043): Terminated: ok {rc=0} 16:10:57.178555 --- ParallelTerminationStrategy: PID 21046 died... 16:10:57.197660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21046): Terminated: ok {rc=0} 16:10:57.242506 --- ParallelTerminationStrategy: PID 21049 died... 16:10:57.261525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21049): Terminated: ok {rc=0} 16:10:57.348254 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:10:58.437905 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:58.450406 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:10:58.523359 tst ping_idle_ping.py: using LAC 22194 16:10:58.643131 tst ping_idle_ping.py: using RAC 9 16:10:58.763983 tst ping_idle_ping.py: using CellId 22194 16:10:58.884591 tst ping_idle_ping.py: using BVCI 22195 16:10:58.994167 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:59.005348 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:59.016210 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:59.027230 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:59.038158 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:59.049251 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:59.060349 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:10:59.071193 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:10:59.186923 tst ping_idle_ping.py:24: start network... 16:10:59.391702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:59.871715 run create_hlr_db(pid=21051): Launched 16:10:59.997417 bus /gobi_6: Setting Powered False 16:11:01.060418 run create_hlr_db(pid=21051): Terminated: ok {rc=0} 16:11:01.524310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21053): Launched 16:11:01.867195 run osmo-hlr_10.42.42.2(pid=21054): Launched 16:11:02.068095 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:02.620412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21056): Launched 16:11:02.925086 run osmo-stp_10.42.42.5(pid=21057): Launched 16:11:03.040158 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:11:03.565768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21059): Launched 16:11:03.682042 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:11:03.938601 run patchelf(pid=21060): Launched 16:11:04.109786 run osmo-stp_10.42.42.5(pid=21057): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21057)] 16:11:04.238571 run osmo-stp_10.42.42.5(pid=21057): stdout: | (launched: 2022-12-09_16:11:02.868877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:04.368716 run osmo-stp_10.42.42.5(pid=21057): stderr: | [0;m[38;5;43m20221209161103039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161103039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161103039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161103040 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161103040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161103040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161103040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:04.499131 run osmo-stp_10.42.42.5(pid=21057): stdout: | (launched: 2022-12-09_16:11:02.868877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:04.623600 run osmo-stp_10.42.42.5(pid=21057): stderr: | [0;m[38;5;43m20221209161103039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161103039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161103039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161103040 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161103040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161103040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161103040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:04.771041 run patchelf(pid=21060): Terminating (SIGINT) 16:11:04.941456 run patchelf(pid=21060): Terminated: ok {rc=0} 16:11:05.063386 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21057): Process ended prematurely: osmo-stp_10.42.42.5(pid=21057) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21057)] [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:11:05.072322 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:11:05.099305 run osmo-hlr_10.42.42.2(pid=21054): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21054)] 16:11:05.147134 run osmo-hlr_10.42.42.2(pid=21054): stdout: | (launched: 2022-12-09_16:11:01.806803) 16:11:05.196878 run osmo-hlr_10.42.42.2(pid=21054): stderr: | [0;m[1;31m20221209161102110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161102110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161102110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161102110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161102110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161102110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161102131 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161102140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161102141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161102141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:05.247167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21053): Terminating (SIGTERM) 16:11:05.287267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21056): Terminating (SIGTERM) 16:11:05.327749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21059): Terminating (SIGTERM) 16:11:05.368228 --- ParallelTerminationStrategy: PID 21053 died... 16:11:05.387575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21053): Terminated: ok {rc=0} 16:11:05.432389 --- ParallelTerminationStrategy: PID 21056 died... 16:11:05.451155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21056): Terminated: ok {rc=0} 16:11:05.495585 --- ParallelTerminationStrategy: PID 21059 died... 16:11:05.514341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21059): Terminated: ok {rc=0} 16:11:05.600578 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:11:06.906987 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:11:06.913573 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:11:06.947707 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:11:06.986330 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:11:07.074109 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:11:07.107457 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:11:07.145587 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:11:07.741926 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:11:07.791557 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:07.802951 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:11:07.874160 tst cs_paging_gprs_active.py: using LAC 22195 16:11:07.996817 tst cs_paging_gprs_active.py: using RAC 10 16:11:08.117724 tst cs_paging_gprs_active.py: using CellId 22195 16:11:08.238568 tst cs_paging_gprs_active.py: using BVCI 22196 16:11:08.352005 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.363062 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.374068 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.384906 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.395953 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.406735 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.417711 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.428662 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:08.439777 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:08.560372 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:08.679547 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:11:08.887763 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:09.198799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21066): Launched 16:11:09.469075 run iperf3-srv_10.42.42.10(pid=21067): Launched 16:11:09.585979 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:11:09.792936 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:10.104738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21068): Launched 16:11:10.377270 run iperf3-srv_10.42.42.10(pid=21069): Launched 16:11:10.493195 tst cs_paging_gprs_active.py:38: start network... 16:11:10.700618 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:11.180866 run create_hlr_db(pid=21070): Launched 16:11:11.307392 bus /gobi_6: Setting Powered False 16:11:12.367975 run create_hlr_db(pid=21070): Terminated: ok {rc=0} 16:11:12.819644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21072): Launched 16:11:13.152003 run osmo-hlr_10.42.42.2(pid=21073): Launched 16:11:13.279452 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:13.847516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21075): Launched 16:11:14.179308 run osmo-stp_10.42.42.5(pid=21076): Launched 16:11:14.305424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:11:14.875126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21078): Launched 16:11:15.001950 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:11:15.282300 run patchelf(pid=21079): Launched 16:11:15.466208 run osmo-stp_10.42.42.5(pid=21076): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21076)] 16:11:15.606291 run osmo-stp_10.42.42.5(pid=21076): stdout: | (launched: 2022-12-09_16:11:14.118473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:15.747510 run osmo-stp_10.42.42.5(pid=21076): stderr: | [0;m[38;5;43m20221209161114309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161114309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161114309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161114310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161114310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161114310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161114310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:15.901657 run osmo-stp_10.42.42.5(pid=21076): stdout: | (launched: 2022-12-09_16:11:14.118473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:16.038735 run osmo-stp_10.42.42.5(pid=21076): stderr: | [0;m[38;5;43m20221209161114309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161114309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161114309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161114310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161114310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161114310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161114310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:16.202666 run patchelf(pid=21079): Terminating (SIGINT) 16:11:16.391627 run patchelf(pid=21079): Terminated: ok {rc=0} 16:11:16.528870 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21076): Process ended prematurely: osmo-stp_10.42.42.5(pid=21076) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21076)] [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:11:16.540255 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 16:11:16.571456 run osmo-hlr_10.42.42.2(pid=21073): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21073)] 16:11:16.625537 run osmo-hlr_10.42.42.2(pid=21073): stdout: | (launched: 2022-12-09_16:11:13.091331) 16:11:16.679623 run osmo-hlr_10.42.42.2(pid=21073): stderr: | [0;m[1;31m20221209161113290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161113290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161113290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161113290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161113291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161113291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161113302 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161113311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161113311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161113311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:16.734490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21066): Terminating (SIGTERM) 16:11:16.779322 run iperf3-srv_10.42.42.10(pid=21067): Terminating (SIGTERM) 16:11:16.825775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21068): Terminating (SIGTERM) 16:11:16.870612 run iperf3-srv_10.42.42.10(pid=21069): Terminating (SIGTERM) 16:11:16.916268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21072): Terminating (SIGTERM) 16:11:16.960561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21075): Terminating (SIGTERM) 16:11:17.004566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21078): Terminating (SIGTERM) 16:11:17.048931 --- ParallelTerminationStrategy: PID 21066 died... 16:11:17.069684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21066): Terminated: ok {rc=0} 16:11:17.119405 --- ParallelTerminationStrategy: PID 21067 died... 16:11:17.139905 run iperf3-srv_10.42.42.10(pid=21067): Terminated {rc=256} 16:11:17.189833 --- ParallelTerminationStrategy: PID 21068 died... 16:11:17.210877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21068): Terminated: ok {rc=0} 16:11:17.257445 --- ParallelTerminationStrategy: PID 21069 died... 16:11:17.276872 run iperf3-srv_10.42.42.10(pid=21069): Terminated {rc=256} 16:11:17.323621 --- ParallelTerminationStrategy: PID 21072 died... 16:11:17.343180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21072): Terminated: ok {rc=0} 16:11:17.390281 --- ParallelTerminationStrategy: PID 21075 died... 16:11:17.409959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21075): Terminated: ok {rc=0} 16:11:17.456699 --- ParallelTerminationStrategy: PID 21078 died... 16:11:17.476323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21078): Terminated: ok {rc=0} 16:11:17.565473 bus /gobi_0: Setting Powered False 16:11:18.664838 bus /gobi_0: Setting Powered False 16:11:19.780423 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:11:20.931649 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:20.944248 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:11:21.020785 tst iperf3.py: using LAC 22196 16:11:21.148718 tst iperf3.py: using RAC 11 16:11:21.279070 tst iperf3.py: using CellId 22196 16:11:21.409386 tst iperf3.py: using BVCI 22197 16:11:21.529583 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.541258 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.552785 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.564571 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.576235 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.587889 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.599648 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.611455 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:21.623299 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:21.745539 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:11:21.970136 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:22.303704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21080): Launched 16:11:22.592643 run iperf3-srv_10.42.42.10(pid=21081): Launched 16:11:22.716510 tst iperf3.py:8: start network... 16:11:22.940066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:23.451619 run create_hlr_db(pid=21082): Launched 16:11:23.578946 bus /gobi_6: Setting Powered False 16:11:24.643460 run create_hlr_db(pid=21082): Terminated: ok {rc=0} 16:11:25.102959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21084): Launched 16:11:25.434416 run osmo-hlr_10.42.42.2(pid=21085): Launched 16:11:25.562611 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:26.130979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21087): Launched 16:11:26.463965 run osmo-stp_10.42.42.5(pid=21088): Launched 16:11:26.591348 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:11:27.160035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21090): Launched 16:11:27.288923 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:11:27.569136 run patchelf(pid=21091): Launched 16:11:27.754213 run osmo-stp_10.42.42.5(pid=21088): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21088)] 16:11:27.894056 run osmo-stp_10.42.42.5(pid=21088): stdout: | (launched: 2022-12-09_16:11:26.403569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:28.035731 run osmo-stp_10.42.42.5(pid=21088): stderr: | [0;m[38;5;43m20221209161126598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161126598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161126598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161126599 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161126599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161126599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161126599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:28.177282 run osmo-stp_10.42.42.5(pid=21088): stdout: | (launched: 2022-12-09_16:11:26.403569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:28.312640 run osmo-stp_10.42.42.5(pid=21088): stderr: | [0;m[38;5;43m20221209161126598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161126598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161126598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161126599 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161126599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161126599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161126599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:28.472657 run patchelf(pid=21091): Terminating (SIGINT) 16:11:28.657669 run patchelf(pid=21091): Terminated: ok {rc=0} 16:11:28.791552 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21088): Process ended prematurely: osmo-stp_10.42.42.5(pid=21088) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21088)] [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 16:11:28.801670 tst iperf3.py:8: Test FAILED (7.9 sec) 16:11:28.831091 run osmo-hlr_10.42.42.2(pid=21085): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21085)] 16:11:28.881855 run osmo-hlr_10.42.42.2(pid=21085): stdout: | (launched: 2022-12-09_16:11:25.374204) 16:11:28.934515 run osmo-hlr_10.42.42.2(pid=21085): stderr: | [0;m[1;31m20221209161125573 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161125573 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161125573 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161125573 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161125573 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161125573 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161125590 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161125601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161125601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161125601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:28.987354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21080): Terminating (SIGTERM) 16:11:29.030005 run iperf3-srv_10.42.42.10(pid=21081): Terminating (SIGTERM) 16:11:29.072413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21084): Terminating (SIGTERM) 16:11:29.115037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21087): Terminating (SIGTERM) 16:11:29.157480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21090): Terminating (SIGTERM) 16:11:29.200550 --- ParallelTerminationStrategy: PID 21080 died... 16:11:29.220612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21080): Terminated: ok {rc=0} 16:11:29.267671 --- ParallelTerminationStrategy: PID 21081 died... 16:11:29.287271 run iperf3-srv_10.42.42.10(pid=21081): Terminated {rc=256} 16:11:29.334231 --- ParallelTerminationStrategy: PID 21084 died... 16:11:29.353925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21084): Terminated: ok {rc=0} 16:11:29.400714 --- ParallelTerminationStrategy: PID 21087 died... 16:11:29.420365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21087): Terminated: ok {rc=0} 16:11:29.467046 --- ParallelTerminationStrategy: PID 21090 died... 16:11:29.486647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21090): Terminated: ok {rc=0} 16:11:29.575623 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:11:30.725265 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:30.737606 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:11:30.809594 tst iperf3m4.py: using LAC 22197 16:11:30.971205 tst iperf3m4.py: using RAC 12 16:11:31.130197 tst iperf3m4.py: using CellId 22197 16:11:31.253563 tst iperf3m4.py: using BVCI 22198 16:11:31.386661 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:31.399114 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:31.411276 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:31.423541 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:31.435906 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:31.447780 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:31.459642 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:31.472425 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:31.485743 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:31.608798 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:31.738218 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:31.866402 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:31.996165 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:11:32.227749 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:32.562269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21093): Launched 16:11:32.852840 run iperf3-srv_10.42.42.10(pid=21094): Launched 16:11:32.977685 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:11:33.202280 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:33.535572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21095): Launched 16:11:33.825914 run iperf3-srv_10.42.42.10(pid=21096): Launched 16:11:33.951056 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:11:34.174290 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:34.506752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21097): Launched 16:11:34.796099 run iperf3-srv_10.42.42.10(pid=21098): Launched 16:11:34.921479 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:11:35.144724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:11:35.477489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21099): Launched 16:11:35.765632 run iperf3-srv_10.42.42.10(pid=21100): Launched 16:11:35.890691 tst iperf3m4.py:8: start network... 16:11:36.113611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:36.623635 run create_hlr_db(pid=21101): Launched 16:11:36.750867 bus /gobi_6: Setting Powered False 16:11:37.815176 run create_hlr_db(pid=21101): Terminated: ok {rc=0} 16:11:38.255638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21103): Launched 16:11:38.587835 run osmo-hlr_10.42.42.2(pid=21104): Launched 16:11:38.716274 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:39.285415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21106): Launched 16:11:39.614732 run osmo-stp_10.42.42.5(pid=21107): Launched 16:11:39.741694 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:11:40.311167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21109): Launched 16:11:40.440806 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:11:40.719690 run patchelf(pid=21110): Launched 16:11:40.904546 run osmo-stp_10.42.42.5(pid=21107): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21107)] 16:11:41.043945 run osmo-stp_10.42.42.5(pid=21107): stdout: | (launched: 2022-12-09_16:11:39.554573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:41.184830 run osmo-stp_10.42.42.5(pid=21107): stderr: | [0;m[38;5;43m20221209161139743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161139744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161139744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161139744 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161139745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161139745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161139745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:41.326409 run osmo-stp_10.42.42.5(pid=21107): stdout: | (launched: 2022-12-09_16:11:39.554573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:41.460661 run osmo-stp_10.42.42.5(pid=21107): stderr: | [0;m[38;5;43m20221209161139743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161139744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161139744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161139744 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161139745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161139745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161139745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:41.620288 run patchelf(pid=21110): Terminating (SIGINT) 16:11:41.805362 run patchelf(pid=21110): Terminated: ok {rc=0} 16:11:41.938622 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21107): Process ended prematurely: osmo-stp_10.42.42.5(pid=21107) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21107)] [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:11:41.948891 tst iperf3m4.py:8: Test FAILED (11.3 sec) 16:11:41.978657 run osmo-hlr_10.42.42.2(pid=21104): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21104)] 16:11:42.028780 run osmo-hlr_10.42.42.2(pid=21104): stdout: | (launched: 2022-12-09_16:11:38.527584) 16:11:42.080630 run osmo-hlr_10.42.42.2(pid=21104): stderr: | [0;m[1;31m20221209161138722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161138722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161138722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161138722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161138722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161138722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161138733 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161138742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161138742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161138742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:42.133067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21093): Terminating (SIGTERM) 16:11:42.174543 run iperf3-srv_10.42.42.10(pid=21094): Terminating (SIGTERM) 16:11:42.216936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21095): Terminating (SIGTERM) 16:11:42.259083 run iperf3-srv_10.42.42.10(pid=21096): Terminating (SIGTERM) 16:11:42.300687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21097): Terminating (SIGTERM) 16:11:42.342763 run iperf3-srv_10.42.42.10(pid=21098): Terminating (SIGTERM) 16:11:42.384488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21099): Terminating (SIGTERM) 16:11:42.426485 run iperf3-srv_10.42.42.10(pid=21100): Terminating (SIGTERM) 16:11:42.468215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21103): Terminating (SIGTERM) 16:11:42.510191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21106): Terminating (SIGTERM) 16:11:42.552128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21109): Terminating (SIGTERM) 16:11:42.594431 --- ParallelTerminationStrategy: PID 21093 died... 16:11:42.614441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21093): Terminated: ok {rc=0} 16:11:42.661472 --- ParallelTerminationStrategy: PID 21094 died... 16:11:42.680864 run iperf3-srv_10.42.42.10(pid=21094): Terminated {rc=256} 16:11:42.727202 --- ParallelTerminationStrategy: PID 21095 died... 16:11:42.746699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21095): Terminated: ok {rc=0} 16:11:42.793361 --- ParallelTerminationStrategy: PID 21096 died... 16:11:42.812785 run iperf3-srv_10.42.42.10(pid=21096): Terminated {rc=256} 16:11:42.859273 --- ParallelTerminationStrategy: PID 21097 died... 16:11:42.878816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21097): Terminated: ok {rc=0} 16:11:42.925548 --- ParallelTerminationStrategy: PID 21098 died... 16:11:42.945090 run iperf3-srv_10.42.42.10(pid=21098): Terminated {rc=256} 16:11:42.991117 --- ParallelTerminationStrategy: PID 21099 died... 16:11:43.010969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21099): Terminated: ok {rc=0} 16:11:43.057859 --- ParallelTerminationStrategy: PID 21100 died... 16:11:43.077416 run iperf3-srv_10.42.42.10(pid=21100): Terminated {rc=256} 16:11:43.123732 --- ParallelTerminationStrategy: PID 21103 died... 16:11:43.143373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21103): Terminated: ok {rc=0} 16:11:43.189899 --- ParallelTerminationStrategy: PID 21106 died... 16:11:43.209375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21106): Terminated: ok {rc=0} 16:11:43.255705 --- ParallelTerminationStrategy: PID 21109 died... 16:11:43.275176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21109): Terminated: ok {rc=0} 16:11:43.363032 bus /gobi_4: Setting Powered False 16:11:44.462799 bus /gobi_4: Setting Powered False 16:11:45.579398 bus /gobi_1: Setting Powered False 16:11:46.688831 bus /gobi_1: Setting Powered False 16:11:47.821531 bus /gobi_0: Setting Powered False 16:11:48.920368 bus /gobi_0: Setting Powered False 16:11:50.036351 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:11:51.137614 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:51.149802 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:11:51.221587 tst ping.py: using LAC 22198 16:11:51.349157 tst ping.py: using RAC 13 16:11:51.477518 tst ping.py: using CellId 22198 16:11:51.600697 tst ping.py: using BVCI 22199 16:11:51.712251 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:51.723661 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:51.734793 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:51.746355 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:51.757956 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:51.769511 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:51.781175 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:51.792434 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:11:51.913893 tst ping.py:19: start network... 16:11:52.133498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:52.634175 run create_hlr_db(pid=21111): Launched 16:11:52.758745 bus /gobi_6: Setting Powered False 16:11:53.822576 run create_hlr_db(pid=21111): Terminated: ok {rc=0} 16:11:54.273934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21113): Launched 16:11:54.599301 run osmo-hlr_10.42.42.2(pid=21114): Launched 16:11:54.725092 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:55.293193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21116): Launched 16:11:55.617623 run osmo-stp_10.42.42.5(pid=21117): Launched 16:11:55.742828 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:11:56.302412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21119): Launched 16:11:56.427578 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:11:56.701525 run patchelf(pid=21120): Launched 16:11:56.882181 run osmo-stp_10.42.42.5(pid=21117): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21117)] 16:11:57.018331 run osmo-stp_10.42.42.5(pid=21117): stdout: | (launched: 2022-12-09_16:11:55.558077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:57.157142 run osmo-stp_10.42.42.5(pid=21117): stderr: | [0;m[38;5;43m20221209161155750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161155750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161155750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161155751 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161155751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161155751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161155751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:57.295866 run osmo-stp_10.42.42.5(pid=21117): stdout: | (launched: 2022-12-09_16:11:55.558077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:57.427702 run osmo-stp_10.42.42.5(pid=21117): stderr: | [0;m[38;5;43m20221209161155750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161155750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161155750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161155751 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161155751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161155751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161155751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:57.584191 run patchelf(pid=21120): Terminating (SIGINT) 16:11:57.764369 run patchelf(pid=21120): Terminated: ok {rc=0} 16:11:57.894457 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21117): Process ended prematurely: osmo-stp_10.42.42.5(pid=21117) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21117)] [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 16:11:57.904134 tst ping.py:22: Test FAILED (6.8 sec) 16:11:57.932829 run osmo-hlr_10.42.42.2(pid=21114): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21114)] 16:11:57.983202 run osmo-hlr_10.42.42.2(pid=21114): stdout: | (launched: 2022-12-09_16:11:54.539884) 16:11:58.034792 run osmo-hlr_10.42.42.2(pid=21114): stderr: | [0;m[1;31m20221209161154738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161154738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161154738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161154738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161154738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161154738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161154750 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161154758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161154758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161154759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:58.087252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21113): Terminating (SIGTERM) 16:11:58.129057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21116): Terminating (SIGTERM) 16:11:58.171035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21119): Terminating (SIGTERM) 16:11:58.213584 --- ParallelTerminationStrategy: PID 21113 died... 16:11:58.233514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21113): Terminated: ok {rc=0} 16:11:58.280140 --- ParallelTerminationStrategy: PID 21116 died... 16:11:58.299666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21116): Terminated: ok {rc=0} 16:11:58.346475 --- ParallelTerminationStrategy: PID 21119 died... 16:11:58.365882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21119): Terminated: ok {rc=0} 16:11:58.454196 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:11:59.538551 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:11:59.550662 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:11:59.624146 tst ping_idle_ping.py: using LAC 22199 16:11:59.744644 tst ping_idle_ping.py: using RAC 14 16:11:59.864447 tst ping_idle_ping.py: using CellId 22199 16:11:59.983431 tst ping_idle_ping.py: using BVCI 22200 16:12:00.094849 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:00.106106 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:00.117097 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:00.128115 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:00.139566 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:00.150912 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:00.162281 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:12:00.173529 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:12:00.290571 tst ping_idle_ping.py:24: start network... 16:12:00.495777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:00.998952 run create_hlr_db(pid=21121): Launched 16:12:01.157344 bus /gobi_6: Setting Powered False 16:12:02.233415 run create_hlr_db(pid=21121): Terminated: ok {rc=0} 16:12:02.670493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21123): Launched 16:12:02.975644 run osmo-hlr_10.42.42.2(pid=21124): Launched 16:12:03.091126 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:03.625216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21126): Launched 16:12:03.930000 run osmo-stp_10.42.42.5(pid=21127): Launched 16:12:04.047993 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:12:04.570036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21129): Launched 16:12:04.687048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:12:04.944724 run patchelf(pid=21130): Launched 16:12:05.114513 run osmo-stp_10.42.42.5(pid=21127): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21127)] 16:12:05.243319 run osmo-stp_10.42.42.5(pid=21127): stdout: | (launched: 2022-12-09_16:12:03.873535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:05.374744 run osmo-stp_10.42.42.5(pid=21127): stderr: | [0;m[38;5;43m20221209161204044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161204044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161204044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161204045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161204045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161204045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161204045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:05.505701 run osmo-stp_10.42.42.5(pid=21127): stdout: | (launched: 2022-12-09_16:12:03.873535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:05.630502 run osmo-stp_10.42.42.5(pid=21127): stderr: | [0;m[38;5;43m20221209161204044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161204044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161204044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161204045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161204045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161204045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161204045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:05.778706 run patchelf(pid=21130): Terminating (SIGINT) 16:12:05.948591 run patchelf(pid=21130): Terminated: ok {rc=0} 16:12:06.071993 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21127): Process ended prematurely: osmo-stp_10.42.42.5(pid=21127) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21127)] [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:12:06.080889 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:12:06.107802 run osmo-hlr_10.42.42.2(pid=21124): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21124)] 16:12:06.155370 run osmo-hlr_10.42.42.2(pid=21124): stdout: | (launched: 2022-12-09_16:12:02.919649) 16:12:06.204831 run osmo-hlr_10.42.42.2(pid=21124): stderr: | [0;m[1;31m20221209161203097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161203097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161203097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161203097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161203097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161203097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161203109 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161203118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161203118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161203119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:06.254877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21123): Terminating (SIGTERM) 16:12:06.295109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21126): Terminating (SIGTERM) 16:12:06.335951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21129): Terminating (SIGTERM) 16:12:06.376299 --- ParallelTerminationStrategy: PID 21123 died... 16:12:06.395518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21123): Terminated: ok {rc=0} 16:12:06.439862 --- ParallelTerminationStrategy: PID 21126 died... 16:12:06.458686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21126): Terminated: ok {rc=0} 16:12:06.502898 --- ParallelTerminationStrategy: PID 21129 died... 16:12:06.521594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21129): Terminated: ok {rc=0} 16:12:06.607222 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:12:07.918780 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:12:07.925937 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:12:07.960462 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:12:07.995703 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:12:08.049985 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:12:08.083639 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:12:08.118061 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:12:08.683035 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:12:08.689522 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:08.701943 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:12:08.779942 tst switch_tch_pdch.py: using LAC 22200 16:12:08.905659 tst switch_tch_pdch.py: using RAC 15 16:12:09.031736 tst switch_tch_pdch.py: using CellId 22200 16:12:09.156601 tst switch_tch_pdch.py: using BVCI 22201 16:12:09.274186 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:09.286051 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:09.297795 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:09.309945 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:09.322368 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:09.334422 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:09.347389 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:12:09.359200 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:12:09.478111 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:12:09.602010 tst switch_tch_pdch.py:51: start network... 16:12:09.822082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:10.323984 run create_hlr_db(pid=21134): Launched 16:12:10.447579 bus /gobi_6: Setting Powered False 16:12:11.511471 run create_hlr_db(pid=21134): Terminated: ok {rc=0} 16:12:11.963528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21136): Launched 16:12:12.289108 run osmo-hlr_10.42.42.2(pid=21137): Launched 16:12:12.414824 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:12.970537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21139): Launched 16:12:13.295226 run osmo-stp_10.42.42.5(pid=21140): Launched 16:12:13.420012 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:12:13.978158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21142): Launched 16:12:14.103184 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:12:14.377346 run patchelf(pid=21143): Launched 16:12:14.558878 run osmo-stp_10.42.42.5(pid=21140): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21140)] 16:12:14.695631 run osmo-stp_10.42.42.5(pid=21140): stdout: | (launched: 2022-12-09_16:12:13.236071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:14.834167 run osmo-stp_10.42.42.5(pid=21140): stderr: | [0;m[38;5;43m20221209161213427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161213427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161213427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161213427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161213428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161213428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161213428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:14.972491 run osmo-stp_10.42.42.5(pid=21140): stdout: | (launched: 2022-12-09_16:12:13.236071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:15.104484 run osmo-stp_10.42.42.5(pid=21140): stderr: | [0;m[38;5;43m20221209161213427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161213427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161213427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161213427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161213428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161213428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161213428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:15.261725 run patchelf(pid=21143): Terminating (SIGINT) 16:12:15.441419 run patchelf(pid=21143): Terminated: ok {rc=0} 16:12:15.571355 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21140): Process ended prematurely: osmo-stp_10.42.42.5(pid=21140) [trial-2361↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21140)] [trial-2361↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:12:15.580888 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 16:12:15.609458 run osmo-hlr_10.42.42.2(pid=21137): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21137)] 16:12:15.659553 run osmo-hlr_10.42.42.2(pid=21137): stdout: | (launched: 2022-12-09_16:12:12.229491) 16:12:15.711534 run osmo-hlr_10.42.42.2(pid=21137): stderr: | [0;m[1;31m20221209161212427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161212427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161212427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161212427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161212427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161212427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161212438 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161212447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161212447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161212447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:15.763909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21136): Terminating (SIGTERM) 16:12:15.805745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21139): Terminating (SIGTERM) 16:12:15.848213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21142): Terminating (SIGTERM) 16:12:15.893158 --- ParallelTerminationStrategy: PID 21136 died... 16:12:15.912922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21136): Terminated: ok {rc=0} 16:12:15.960204 --- ParallelTerminationStrategy: PID 21139 died... 16:12:15.980230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21139): Terminated: ok {rc=0} 16:12:16.027443 --- ParallelTerminationStrategy: PID 21142 died... 16:12:16.047291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21142): Terminated: ok {rc=0} 16:12:16.138701 bus /gobi_0: Setting Powered False 16:12:17.239437 bus /gobi_0: Setting Powered False 16:12:18.357158 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:12:19.612588 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:12:19.618600 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:12:19.652570 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:12:19.687292 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:12:19.740234 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:12:19.773967 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:12:19.808567 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:12:20.366860 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:12:20.371888 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:20.382939 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:12:20.452807 tst switch_tch_pdch.py: using LAC 22201 16:12:20.586712 tst switch_tch_pdch.py: using RAC 16 16:12:20.708380 tst switch_tch_pdch.py: using CellId 22201 16:12:20.826357 tst switch_tch_pdch.py: using BVCI 22202 16:12:20.937081 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:20.948197 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:20.959167 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:20.970128 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:20.981072 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:20.992365 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:21.003508 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:12:21.014448 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:12:21.135988 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:12:21.254464 tst switch_tch_pdch.py:51: start network... 16:12:21.460027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:21.905471 run create_hlr_db(pid=21147): Launched 16:12:22.029487 bus /gobi_6: Setting Powered False 16:12:23.090734 run create_hlr_db(pid=21147): Terminated: ok {rc=0} 16:12:23.490320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21149): Launched 16:12:23.795073 run osmo-hlr_10.42.42.2(pid=21150): Launched 16:12:23.911861 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:24.422861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21152): Launched 16:12:24.726261 run osmo-stp_10.42.42.5(pid=21153): Launched 16:12:24.841159 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:12:25.337337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21155): Launched 16:12:25.453034 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:12:25.708653 run patchelf(pid=21156): Launched 16:12:25.877642 run osmo-stp_10.42.42.5(pid=21153): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21153)] 16:12:26.005454 run osmo-stp_10.42.42.5(pid=21153): stdout: | (launched: 2022-12-09_16:12:24.670244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:26.136038 run osmo-stp_10.42.42.5(pid=21153): stderr: | [0;m[38;5;43m20221209161224842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161224842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161224842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161224843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161224843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161224843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161224843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:26.266545 run osmo-stp_10.42.42.5(pid=21153): stdout: | (launched: 2022-12-09_16:12:24.670244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:26.390219 run osmo-stp_10.42.42.5(pid=21153): stderr: | [0;m[38;5;43m20221209161224842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161224842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161224842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161224843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161224843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161224843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161224843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:26.537149 run patchelf(pid=21156): Terminating (SIGINT) 16:12:26.706395 run patchelf(pid=21156): Terminated: ok {rc=0} 16:12:26.829114 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21153): Process ended prematurely: osmo-stp_10.42.42.5(pid=21153) [trial-2361↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21153)] [trial-2361↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:12:26.837998 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 16:12:26.864554 run osmo-hlr_10.42.42.2(pid=21150): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21150)] 16:12:26.912098 run osmo-hlr_10.42.42.2(pid=21150): stdout: | (launched: 2022-12-09_16:12:23.738940) 16:12:26.961427 run osmo-hlr_10.42.42.2(pid=21150): stderr: | [0;m[1;31m20221209161223915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161223915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161223915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161223915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161223915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161223915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161223927 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161223939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161223939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161223939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:27.011162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21149): Terminating (SIGTERM) 16:12:27.051210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21152): Terminating (SIGTERM) 16:12:27.091450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21155): Terminating (SIGTERM) 16:12:27.132148 --- ParallelTerminationStrategy: PID 21149 died... 16:12:27.151537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21149): Terminated: ok {rc=0} 16:12:27.196208 --- ParallelTerminationStrategy: PID 21152 died... 16:12:27.215160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21152): Terminated: ok {rc=0} 16:12:27.259598 --- ParallelTerminationStrategy: PID 21155 died... 16:12:27.278622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21155): Terminated: ok {rc=0} 16:12:27.365112 bus /gobi_0: Setting Powered False 16:12:28.464449 bus /gobi_0: Setting Powered False 16:12:29.581463 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_sms:trx-umtrx --------------------------------------------------------------------- 16:12:30.847711 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:12:30.852666 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:12:30.903083 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 16:12:30.913142 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 16:12:30.974671 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:12:31.019070 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 16:12:31.026812 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 16:12:31.569437 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 16:12:31.576104 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 16:12:31.588462 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 16:12:31.642198 tst mo_mt_sms.py: using LAC 22202 16:12:31.766723 tst mo_mt_sms.py: using RAC 17 16:12:31.922195 tst mo_mt_sms.py: using CellId 22202 16:12:32.055671 tst mo_mt_sms.py: using BVCI 22203 16:12:32.167956 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:12:32.285569 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:12:32.404648 tst mo_mt_sms.py:9: start nitb and bts... 16:12:32.626826 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:12:33.287377 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21161): Launched 16:12:33.612249 run osmo-nitb_10.42.42.2(pid=21162): Launched 16:12:33.791984 run osmo-nitb_10.42.42.2(pid=21162): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21162)] 16:12:33.936807 run osmo-nitb_10.42.42.2(pid=21162): stdout: | (launched: 2022-12-09_16:12:33.552909) 16:12:34.083746 run osmo-nitb_10.42.42.2(pid=21162): stderr: | (launched: 2022-12-09_16:12:33.601137) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:12:34.231039 run osmo-nitb_10.42.42.2(pid=21162): stdout: | (launched: 2022-12-09_16:12:33.552909) 16:12:34.372098 run osmo-nitb_10.42.42.2(pid=21162): stderr: | (launched: 2022-12-09_16:12:33.601137) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21162): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21162) [trial-2361↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21162)] 16:12:34.734567 tst osmo-nitb_10.42.42.2(pid=21162): stdout: | (launched: 2022-12-09_16:12:33.552909) 16:12:34.866605 tst osmo-nitb_10.42.42.2(pid=21162): stderr: | (launched: 2022-12-09_16:12:33.601137) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:12:35.021965 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=21162): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21162) [trial-2361↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21162)] [trial-2361↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 16:12:35.031252 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 16:12:35.038874 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21161): Terminating (SIGTERM) 16:12:35.250358 --- ParallelTerminationStrategy: PID 21161 died... 16:12:35.272104 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21161): Terminated: ok {rc=0} 16:12:35.361413 bus /sierra_3: Setting Powered False 16:12:36.459280 bus /sierra_3: Setting Powered False 16:12:37.576262 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 sms:trx-umtrx --------------------------------------------------------------------- 16:12:38.777867 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:12:38.782383 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:12:38.814663 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:12:38.841719 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 16:12:38.895502 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:12:38.928089 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:12:38.955097 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 16:12:39.499521 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 16:12:39.504448 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:39.515092 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 16:12:39.562014 tst mo_mt_sms.py: using LAC 22203 16:12:39.680866 tst mo_mt_sms.py: using RAC 18 16:12:39.800453 tst mo_mt_sms.py: using CellId 22203 16:12:39.918933 tst mo_mt_sms.py: using BVCI 22204 16:12:40.029969 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:40.040733 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:40.051358 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:40.061876 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:40.072294 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:40.082790 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:12:40.197126 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:12:40.317889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:40.820663 run create_hlr_db(pid=21168): Launched 16:12:40.947252 bus /sierra_2: Setting Powered False 16:12:42.011526 run create_hlr_db(pid=21168): Terminated: ok {rc=0} 16:12:42.446734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21170): Launched 16:12:42.749412 run osmo-hlr_10.42.42.2(pid=21171): Launched 16:12:42.864220 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:43.404736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21173): Launched 16:12:43.708886 run osmo-stp_10.42.42.5(pid=21174): Launched 16:12:43.824299 run osmo-msc_10.42.42.6: Starting osmo-msc 16:12:44.373254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21176): Launched 16:12:44.676742 run osmo-msc_10.42.42.6(pid=21177): Launched 16:12:44.845431 run osmo-stp_10.42.42.5(pid=21174): ERR: Terminated: ERROR {rc=1} [trial-2361↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21174)] 16:12:44.972799 run osmo-stp_10.42.42.5(pid=21174): stdout: | (launched: 2022-12-09_16:12:43.652451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:45.100903 run osmo-stp_10.42.42.5(pid=21174): stderr: | [0;m[38;5;43m20221209161243824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161243824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161243825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161243825 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161243825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161243826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161243826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:45.226883 run osmo-stp_10.42.42.5(pid=21174): stdout: | (launched: 2022-12-09_16:12:43.652451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:45.347775 run osmo-stp_10.42.42.5(pid=21174): stderr: | [0;m[38;5;43m20221209161243824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161243824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161243825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161243825 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161243825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161243826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161243826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:45.492048 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=21174): Process ended prematurely: osmo-stp_10.42.42.5(pid=21174) [trial-2361↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21174)] [trial-2361↪sms:trx-umtrx↪mo_mt_sms.py:16] 16:12:45.500368 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 16:12:45.526406 run osmo-hlr_10.42.42.2(pid=21171): ERR: Terminated: ERROR {rc=237} [trial-2361↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21171)] 16:12:45.573947 run osmo-hlr_10.42.42.2(pid=21171): stdout: | (launched: 2022-12-09_16:12:42.693865) 16:12:45.623071 run osmo-hlr_10.42.42.2(pid=21171): stderr: | [0;m[1;31m20221209161242870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161242870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161242870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161242870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161242870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161242870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161242881 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161242890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161242890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161242890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:45.692040 run osmo-msc_10.42.42.6(pid=21177): ERR: Terminated: ERROR {rc=2} [trial-2361↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21177)] 16:12:45.739421 run osmo-msc_10.42.42.6(pid=21177): stdout: | (launched: 2022-12-09_16:12:44.620396) 16:12:45.789208 run osmo-msc_10.42.42.6(pid=21177): stderr: | [0;m[38;5;43m20221209161244893 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161244893 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5a4ad3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161244893 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161244893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161244894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161244894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161244895 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161244896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161244896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161244896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:12:45.843737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21170): Terminating (SIGTERM) 16:12:45.902598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21173): Terminating (SIGTERM) 16:12:45.949993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21176): Terminating (SIGTERM) 16:12:45.992517 --- ParallelTerminationStrategy: PID 21170 died... 16:12:46.012562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21170): Terminated: ok {rc=0} 16:12:46.058026 --- ParallelTerminationStrategy: PID 21173 died... 16:12:46.077280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21173): Terminated: ok {rc=0} 16:12:46.122298 --- ParallelTerminationStrategy: PID 21176 died... 16:12:46.141406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21176): Terminated: ok {rc=0} 16:12:46.226568 bus /sierra_3: Setting Powered False 16:12:47.325228 bus /sierra_3: Setting Powered False 16:12:48.440998 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 16:12:49.671385 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:12:49.675492 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:12:49.709627 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 16:12:49.716663 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 16:12:49.755453 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:12:49.788073 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 16:12:49.794947 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 16:12:50.310602 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2361 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 16:12:50.316090 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 16:12:50.326962 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 16:12:50.375281 tst assert_extension.py: using LAC 22204 16:12:50.495964 tst assert_extension.py: using RAC 19 16:12:50.616117 tst assert_extension.py: using CellId 22204 16:12:50.734651 tst assert_extension.py: using BVCI 22205 16:12:50.845320 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 16:12:50.966787 tst assert_extension.py:10: start nitb and bts... 16:12:51.186936 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:12:51.850113 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21182): Launched 16:12:52.176902 run osmo-nitb_10.42.42.2(pid=21183): Launched 16:12:52.356679 run osmo-nitb_10.42.42.2(pid=21183): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21183)] 16:12:52.501837 run osmo-nitb_10.42.42.2(pid=21183): stdout: | (launched: 2022-12-09_16:12:52.117565) 16:12:52.648570 run osmo-nitb_10.42.42.2(pid=21183): stderr: | (launched: 2022-12-09_16:12:52.165757) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:12:52.795412 run osmo-nitb_10.42.42.2(pid=21183): stdout: | (launched: 2022-12-09_16:12:52.117565) 16:12:52.936103 run osmo-nitb_10.42.42.2(pid=21183): stderr: | (launched: 2022-12-09_16:12:52.165757) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21183): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21183) [trial-2361↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21183)] 16:12:53.300023 tst osmo-nitb_10.42.42.2(pid=21183): stdout: | (launched: 2022-12-09_16:12:52.117565) 16:12:53.431342 tst osmo-nitb_10.42.42.2(pid=21183): stderr: | (launched: 2022-12-09_16:12:52.165757) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:12:53.585891 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=21183): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21183) [trial-2361↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21183)] [trial-2361↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 16:12:53.594965 tst assert_extension.py:12: Test FAILED (3.3 sec) 16:12:53.602051 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21182): Terminating (SIGTERM) 16:12:53.814729 --- ParallelTerminationStrategy: PID 21182 died... 16:12:53.836534 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21182): Terminated: ok {rc=0} 16:12:53.926185 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 ussd:trx-umtrx --------------------------------------------------------------------- 16:12:55.111668 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:12:55.116067 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:12:55.151642 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:12:55.178986 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 16:12:55.215503 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:12:55.248615 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:12:55.275929 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 16:12:55.804414 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2361 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 16:12:55.809702 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:55.820393 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 16:12:55.868860 tst assert_extension.py: using LAC 22205 16:12:55.986369 tst assert_extension.py: using RAC 20 16:12:56.103718 tst assert_extension.py: using CellId 22205 16:12:56.220593 tst assert_extension.py: using BVCI 22206 16:12:56.329902 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:56.340516 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:56.351145 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:56.361869 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:56.372880 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:12:56.383621 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 16:12:56.501208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:57.004128 run create_hlr_db(pid=21187): Launched 16:12:57.129729 bus /sierra_2: Setting Powered False 16:12:58.193801 run create_hlr_db(pid=21187): Terminated: ok {rc=0} 16:12:58.630426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21189): Launched 16:12:58.937481 run osmo-hlr_10.42.42.2(pid=21190): Launched 16:12:59.053567 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:59.599724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21192): Launched 16:12:59.903139 run osmo-stp_10.42.42.5(pid=21193): Launched 16:13:00.018436 run osmo-msc_10.42.42.6: Starting osmo-msc 16:13:00.564409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21195): Launched 16:13:00.877676 run osmo-msc_10.42.42.6(pid=21196): Launched 16:13:01.254761 run osmo-stp_10.42.42.5(pid=21193): ERR: Terminated: ERROR {rc=1} [trial-2361↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21193)] 16:13:01.446600 run osmo-stp_10.42.42.5(pid=21193): stdout: | (launched: 2022-12-09_16:12:59.847182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:01.689431 run osmo-stp_10.42.42.5(pid=21193): stderr: | [0;m[38;5;43m20221209161300016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161300016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161300016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161300017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161300017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161300017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161300017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:01.828819 run osmo-stp_10.42.42.5(pid=21193): stdout: | (launched: 2022-12-09_16:12:59.847182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:01.992367 run osmo-stp_10.42.42.5(pid=21193): stderr: | [0;m[38;5;43m20221209161300016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161300016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161300016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161300017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161300017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161300017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161300017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:02.175604 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=21193): Process ended prematurely: osmo-stp_10.42.42.5(pid=21193) [trial-2361↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21193)] [trial-2361↪ussd:trx-umtrx↪assert_extension.py:17] 16:13:02.184448 tst assert_extension.py:17: Test FAILED (6.4 sec) 16:13:02.212359 run osmo-hlr_10.42.42.2(pid=21190): ERR: Terminated: ERROR {rc=237} [trial-2361↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21190)] 16:13:02.260889 run osmo-hlr_10.42.42.2(pid=21190): stdout: | (launched: 2022-12-09_16:12:58.881215) 16:13:02.310365 run osmo-hlr_10.42.42.2(pid=21190): stderr: | [0;m[1;31m20221209161259055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161259055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161259055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161259055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161259056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161259056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161259068 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161259076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161259076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161259076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:02.379729 run osmo-msc_10.42.42.6(pid=21196): ERR: Terminated: ERROR {rc=2} [trial-2361↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21196)] 16:13:02.427965 run osmo-msc_10.42.42.6(pid=21196): stdout: | (launched: 2022-12-09_16:13:00.810801) 16:13:02.477611 run osmo-msc_10.42.42.6(pid=21196): stderr: | [0;m[38;5;43m20221209161301310 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161301310 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fecdc349c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161301311 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161301311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161301311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161301311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161301321 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161301321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161301322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161301322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:13:02.527455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21189): Terminating (SIGTERM) 16:13:02.567550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21192): Terminating (SIGTERM) 16:13:02.607422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21195): Terminating (SIGTERM) 16:13:02.647859 --- ParallelTerminationStrategy: PID 21189 died... 16:13:02.667025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21189): Terminated: ok {rc=0} 16:13:02.711006 --- ParallelTerminationStrategy: PID 21192 died... 16:13:02.729663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21192): Terminated: ok {rc=0} 16:13:02.774092 --- ParallelTerminationStrategy: PID 21195 died... 16:13:02.792679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21195): Terminated: ok {rc=0} 16:13:02.876752 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:13:04.087041 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:13:04.094926 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:13:04.131256 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:13:04.159933 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:13:04.216048 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:13:04.250860 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:13:04.279327 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:13:04.827006 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:13:04.881890 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:04.893728 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:13:04.965645 tst mo_mt_call.py: using LAC 22206 16:13:05.088470 tst mo_mt_call.py: using RAC 21 16:13:05.212051 tst mo_mt_call.py: using CellId 22206 16:13:05.334451 tst mo_mt_call.py: using BVCI 22207 16:13:05.447578 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:05.458941 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:05.470136 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:05.481424 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:05.492612 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:05.503756 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:13:05.624084 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:13:05.743837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:06.222553 run create_hlr_db(pid=21201): Launched 16:13:06.351293 bus /sierra_2: Setting Powered False 16:13:07.412648 run create_hlr_db(pid=21201): Terminated: ok {rc=0} 16:13:07.865694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21203): Launched 16:13:08.198325 run osmo-hlr_10.42.42.2(pid=21204): Launched 16:13:08.328329 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:08.898366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21206): Launched 16:13:09.230275 run osmo-stp_10.42.42.5(pid=21207): Launched 16:13:09.358861 run osmo-msc_10.42.42.6: Starting osmo-msc 16:13:09.956454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21209): Launched 16:13:10.289331 run osmo-msc_10.42.42.6(pid=21210): Launched 16:13:10.475327 run osmo-stp_10.42.42.5(pid=21207): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21207)] 16:13:10.615315 run osmo-stp_10.42.42.5(pid=21207): stdout: | (launched: 2022-12-09_16:13:09.169975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:10.755447 run osmo-stp_10.42.42.5(pid=21207): stderr: | [0;m[38;5;43m20221209161309364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161309364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161309364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161309364 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161309365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161309365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161309365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:10.895100 run osmo-stp_10.42.42.5(pid=21207): stdout: | (launched: 2022-12-09_16:13:09.169975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:11.026922 run osmo-stp_10.42.42.5(pid=21207): stderr: | [0;m[38;5;43m20221209161309364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161309364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161309364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161309364 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161309365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161309365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161309365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:11.184734 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21207): Process ended prematurely: osmo-stp_10.42.42.5(pid=21207) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21207)] [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:13:11.194749 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:13:11.223210 run osmo-hlr_10.42.42.2(pid=21204): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21204)] 16:13:11.274251 run osmo-hlr_10.42.42.2(pid=21204): stdout: | (launched: 2022-12-09_16:13:08.137987) 16:13:11.326652 run osmo-hlr_10.42.42.2(pid=21204): stderr: | [0;m[1;31m20221209161308341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161308341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161308341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161308341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161308341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161308341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161308353 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161308361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161308361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161308362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:11.399534 run osmo-msc_10.42.42.6(pid=21210): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21210)] 16:13:11.450043 run osmo-msc_10.42.42.6(pid=21210): stdout: | (launched: 2022-12-09_16:13:10.228236) 16:13:11.502485 run osmo-msc_10.42.42.6(pid=21210): stderr: | [0;m[38;5;43m20221209161310555 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161310556 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcb2beccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161310556 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161310556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161310556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161310556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161310558 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161310559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161310559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161310559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:13:11.554867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21203): Terminating (SIGTERM) 16:13:11.597263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21206): Terminating (SIGTERM) 16:13:11.639614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21209): Terminating (SIGTERM) 16:13:11.682014 --- ParallelTerminationStrategy: PID 21203 died... 16:13:11.702147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21203): Terminated: ok {rc=0} 16:13:11.749441 --- ParallelTerminationStrategy: PID 21206 died... 16:13:11.769244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21206): Terminated: ok {rc=0} 16:13:11.816565 --- ParallelTerminationStrategy: PID 21209 died... 16:13:11.836349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21209): Terminated: ok {rc=0} 16:13:11.926273 bus /sierra_3: Setting Powered False 16:13:13.025184 bus /sierra_3: Setting Powered False 16:13:14.142335 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:13:15.293071 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:15.305874 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:13:15.381357 tst mo_mt_call_osmux.py: using LAC 22207 16:13:15.510516 tst mo_mt_call_osmux.py: using RAC 22 16:13:15.638120 tst mo_mt_call_osmux.py: using CellId 22207 16:13:15.765178 tst mo_mt_call_osmux.py: using BVCI 22208 16:13:15.904419 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:15.916790 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:15.929225 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:15.942402 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:15.954770 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:13:15.967374 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:13:16.103456 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:13:16.266290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:16.804357 run create_hlr_db(pid=21212): Launched 16:13:16.968712 bus /sierra_2: Setting Powered False 16:13:18.030675 run create_hlr_db(pid=21212): Terminated: ok {rc=0} 16:13:18.475780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21214): Launched 16:13:18.786703 run osmo-hlr_10.42.42.2(pid=21215): Launched 16:13:18.904318 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:19.434031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21217): Launched 16:13:19.743287 run osmo-stp_10.42.42.5(pid=21218): Launched 16:13:19.861509 run osmo-msc_10.42.42.6: Starting osmo-msc 16:13:20.421247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21220): Launched 16:13:20.732223 run osmo-msc_10.42.42.6(pid=21221): Launched 16:13:20.904675 run osmo-stp_10.42.42.5(pid=21218): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21218)] 16:13:21.035461 run osmo-stp_10.42.42.5(pid=21218): stdout: | (launched: 2022-12-09_16:13:19.686238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:21.166141 run osmo-stp_10.42.42.5(pid=21218): stderr: | [0;m[38;5;43m20221209161319859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161319859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161319859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161319860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161319860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161319860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161319860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:21.294914 run osmo-stp_10.42.42.5(pid=21218): stdout: | (launched: 2022-12-09_16:13:19.686238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:21.417690 run osmo-stp_10.42.42.5(pid=21218): stderr: | [0;m[38;5;43m20221209161319859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161319859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161319859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161319860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161319860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161319860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161319860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:21.564642 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21218): Process ended prematurely: osmo-stp_10.42.42.5(pid=21218) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21218)] [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:13:21.573880 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:13:21.600706 run osmo-hlr_10.42.42.2(pid=21215): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21215)] 16:13:21.648892 run osmo-hlr_10.42.42.2(pid=21215): stdout: | (launched: 2022-12-09_16:13:18.729607) 16:13:21.698559 run osmo-hlr_10.42.42.2(pid=21215): stderr: | [0;m[1;31m20221209161318909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161318909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161318909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161318909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161318909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161318909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161318924 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161318934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161318935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161318935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:21.768012 run osmo-msc_10.42.42.6(pid=21221): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21221)] 16:13:21.815756 run osmo-msc_10.42.42.6(pid=21221): stdout: | (launched: 2022-12-09_16:13:20.675316) 16:13:21.865216 run osmo-msc_10.42.42.6(pid=21221): stderr: | [0;m[38;5;43m20221209161320948 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161320948 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f43b41efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161320948 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161320948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161320949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161320949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161320951 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161320951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161320951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161320951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:13:21.914938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21214): Terminating (SIGTERM) 16:13:21.954749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21217): Terminating (SIGTERM) 16:13:21.994573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21220): Terminating (SIGTERM) 16:13:22.034943 --- ParallelTerminationStrategy: PID 21214 died... 16:13:22.054138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21214): Terminated: ok {rc=0} 16:13:22.098730 --- ParallelTerminationStrategy: PID 21217 died... 16:13:22.117481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21217): Terminated: ok {rc=0} 16:13:22.161415 --- ParallelTerminationStrategy: PID 21220 died... 16:13:22.180087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21220): Terminated: ok {rc=0} 16:13:22.263699 bus /sierra_3: Setting Powered False 16:13:23.359953 bus /sierra_3: Setting Powered False 16:13:24.476936 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:13:25.729124 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:13:25.736700 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:13:25.771858 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:13:25.799529 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:13:25.853476 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:13:25.887343 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:13:25.915382 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:13:26.467932 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:13:26.521134 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:26.533246 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:13:26.603883 tst mo_mt_call.py: using LAC 22208 16:13:26.731918 tst mo_mt_call.py: using RAC 23 16:13:26.861850 tst mo_mt_call.py: using CellId 22208 16:13:26.990900 tst mo_mt_call.py: using BVCI 22209 16:13:27.109773 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:27.121510 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:27.132898 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:27.144610 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:27.156588 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:27.168515 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:13:27.288005 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:13:27.407434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:27.887280 run create_hlr_db(pid=21227): Launched 16:13:28.013547 bus /sierra_2: Setting Powered False 16:13:29.074753 run create_hlr_db(pid=21227): Terminated: ok {rc=0} 16:13:29.527065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21229): Launched 16:13:29.862767 run osmo-hlr_10.42.42.2(pid=21230): Launched 16:13:29.991698 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:30.564367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21232): Launched 16:13:30.909512 run osmo-stp_10.42.42.5(pid=21233): Launched 16:13:31.103028 run osmo-msc_10.42.42.6: Starting osmo-msc 16:13:31.804015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21235): Launched 16:13:32.152217 run osmo-msc_10.42.42.6(pid=21236): Launched 16:13:32.347355 run osmo-stp_10.42.42.5(pid=21233): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21233)] 16:13:32.488689 run osmo-stp_10.42.42.5(pid=21233): stdout: | (launched: 2022-12-09_16:13:30.843664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:32.630657 run osmo-stp_10.42.42.5(pid=21233): stderr: | [0;m[38;5;43m20221209161331124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161331124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161331124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161331125 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161331125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161331125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161331125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:32.772055 run osmo-stp_10.42.42.5(pid=21233): stdout: | (launched: 2022-12-09_16:13:30.843664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:32.904414 run osmo-stp_10.42.42.5(pid=21233): stderr: | [0;m[38;5;43m20221209161331124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161331124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161331124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161331125 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161331125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161331125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161331125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:33.062667 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21233): Process ended prematurely: osmo-stp_10.42.42.5(pid=21233) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21233)] [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:13:33.072444 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 16:13:33.101282 run osmo-hlr_10.42.42.2(pid=21230): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21230)] 16:13:33.152819 run osmo-hlr_10.42.42.2(pid=21230): stdout: | (launched: 2022-12-09_16:13:29.802351) 16:13:33.205641 run osmo-hlr_10.42.42.2(pid=21230): stderr: | [0;m[1;31m20221209161330002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161330002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161330003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161330003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161330003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161330003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161330015 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161330024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161330024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161330024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:33.279261 run osmo-msc_10.42.42.6(pid=21236): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21236)] 16:13:33.330529 run osmo-msc_10.42.42.6(pid=21236): stdout: | (launched: 2022-12-09_16:13:32.091594) 16:13:33.383338 run osmo-msc_10.42.42.6(pid=21236): stderr: | [0;m[38;5;43m20221209161332468 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161332468 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f74e426bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161332468 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161332468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161332469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161332469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161332472 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161332473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161332473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161332473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:13:33.436014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21229): Terminating (SIGTERM) 16:13:33.478913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21232): Terminating (SIGTERM) 16:13:33.521661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21235): Terminating (SIGTERM) 16:13:33.564906 --- ParallelTerminationStrategy: PID 21229 died... 16:13:33.585301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21229): Terminated: ok {rc=0} 16:13:33.632908 --- ParallelTerminationStrategy: PID 21232 died... 16:13:33.652914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21232): Terminated: ok {rc=0} 16:13:33.700909 --- ParallelTerminationStrategy: PID 21235 died... 16:13:33.721327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21235): Terminated: ok {rc=0} 16:13:33.811579 bus /sierra_3: Setting Powered False 16:13:34.912733 bus /sierra_3: Setting Powered False 16:13:36.030606 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:13:37.182885 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:37.195706 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:13:37.268561 tst mo_mt_call_osmux.py: using LAC 22209 16:13:37.399065 tst mo_mt_call_osmux.py: using RAC 24 16:13:37.527573 tst mo_mt_call_osmux.py: using CellId 22209 16:13:37.655735 tst mo_mt_call_osmux.py: using BVCI 22210 16:13:37.775360 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:37.787317 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:37.799051 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:37.811066 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:37.823700 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:13:37.835868 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:13:37.959914 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:13:38.084363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:38.563876 run create_hlr_db(pid=21238): Launched 16:13:38.690760 bus /sierra_2: Setting Powered False 16:13:39.751248 run create_hlr_db(pid=21238): Terminated: ok {rc=0} 16:13:40.202806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21240): Launched 16:13:40.535097 run osmo-hlr_10.42.42.2(pid=21241): Launched 16:13:40.661795 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:41.229992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21243): Launched 16:13:41.562512 run osmo-stp_10.42.42.5(pid=21244): Launched 16:13:41.688802 run osmo-msc_10.42.42.6: Starting osmo-msc 16:13:42.286101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21246): Launched 16:13:42.618283 run osmo-msc_10.42.42.6(pid=21247): Launched 16:13:42.804257 run osmo-stp_10.42.42.5(pid=21244): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21244)] 16:13:42.943147 run osmo-stp_10.42.42.5(pid=21244): stdout: | (launched: 2022-12-09_16:13:41.501832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:43.082915 run osmo-stp_10.42.42.5(pid=21244): stderr: | [0;m[38;5;43m20221209161341695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161341695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161341695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161341695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161341696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161341696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161341696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:43.221191 run osmo-stp_10.42.42.5(pid=21244): stdout: | (launched: 2022-12-09_16:13:41.501832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:43.353348 run osmo-stp_10.42.42.5(pid=21244): stderr: | [0;m[38;5;43m20221209161341695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161341695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161341695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161341695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161341696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161341696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161341696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:43.510665 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21244): Process ended prematurely: osmo-stp_10.42.42.5(pid=21244) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21244)] [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:13:43.520382 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:13:43.549203 run osmo-hlr_10.42.42.2(pid=21241): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21241)] 16:13:43.599590 run osmo-hlr_10.42.42.2(pid=21241): stdout: | (launched: 2022-12-09_16:13:40.474851) 16:13:43.651590 run osmo-hlr_10.42.42.2(pid=21241): stderr: | [0;m[1;31m20221209161340673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161340673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161340673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161340673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161340673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161340673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161340685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161340694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161340694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161340694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:43.724183 run osmo-msc_10.42.42.6(pid=21247): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21247)] 16:13:43.774119 run osmo-msc_10.42.42.6(pid=21247): stdout: | (launched: 2022-12-09_16:13:42.557963) 16:13:43.825952 run osmo-msc_10.42.42.6(pid=21247): stderr: | [0;m[38;5;43m20221209161342883 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161342883 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fed2232cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161342883 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161342883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161342883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161342883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161342885 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161342886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161342886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161342886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:13:43.878066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21240): Terminating (SIGTERM) 16:13:43.920145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21243): Terminating (SIGTERM) 16:13:43.962278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21246): Terminating (SIGTERM) 16:13:44.004635 --- ParallelTerminationStrategy: PID 21240 died... 16:13:44.024652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21240): Terminated: ok {rc=0} 16:13:44.071470 --- ParallelTerminationStrategy: PID 21243 died... 16:13:44.091198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21243): Terminated: ok {rc=0} 16:13:44.137750 --- ParallelTerminationStrategy: PID 21246 died... 16:13:44.157326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21246): Terminated: ok {rc=0} 16:13:44.245621 bus /sierra_3: Setting Powered False 16:13:45.343868 bus /sierra_3: Setting Powered False 16:13:46.459882 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:13:47.713148 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:13:47.720281 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:13:47.755301 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:13:47.783425 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:13:47.838934 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:13:47.873951 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:13:47.901811 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:13:48.450519 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:13:48.504417 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:48.516359 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:13:48.587537 tst mo_mt_call.py: using LAC 22210 16:13:48.717578 tst mo_mt_call.py: using RAC 25 16:13:48.841395 tst mo_mt_call.py: using CellId 22210 16:13:48.963422 tst mo_mt_call.py: using BVCI 22211 16:13:49.076440 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:49.087792 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:49.099006 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:49.110207 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:49.121425 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:49.132508 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:13:49.252372 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:13:49.373619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:49.851441 run create_hlr_db(pid=21252): Launched 16:13:49.977670 bus /sierra_2: Setting Powered False 16:13:51.039302 run create_hlr_db(pid=21252): Terminated: ok {rc=0} 16:13:51.490696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21254): Launched 16:13:51.824868 run osmo-hlr_10.42.42.2(pid=21255): Launched 16:13:51.953546 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:52.524314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21257): Launched 16:13:52.855983 run osmo-stp_10.42.42.5(pid=21258): Launched 16:13:52.982138 run osmo-msc_10.42.42.6: Starting osmo-msc 16:13:53.580504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21260): Launched 16:13:53.913049 run osmo-msc_10.42.42.6(pid=21261): Launched 16:13:54.097738 run osmo-stp_10.42.42.5(pid=21258): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21258)] 16:13:54.236346 run osmo-stp_10.42.42.5(pid=21258): stdout: | (launched: 2022-12-09_16:13:52.795301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:54.376880 run osmo-stp_10.42.42.5(pid=21258): stderr: | [0;m[38;5;43m20221209161352992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161352992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161352993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161352993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161352993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161352993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161352993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:54.515854 run osmo-stp_10.42.42.5(pid=21258): stdout: | (launched: 2022-12-09_16:13:52.795301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:54.647731 run osmo-stp_10.42.42.5(pid=21258): stderr: | [0;m[38;5;43m20221209161352992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161352992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161352993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161352993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161352993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161352993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161352993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:54.805498 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21258): Process ended prematurely: osmo-stp_10.42.42.5(pid=21258) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21258)] [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:13:54.815250 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:13:54.844153 run osmo-hlr_10.42.42.2(pid=21255): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21255)] 16:13:54.895413 run osmo-hlr_10.42.42.2(pid=21255): stdout: | (launched: 2022-12-09_16:13:51.764607) 16:13:54.948331 run osmo-hlr_10.42.42.2(pid=21255): stderr: | [0;m[1;31m20221209161351966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161351966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161351966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161351966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161351966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161351966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161351979 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161351987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161351987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161351988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:55.021764 run osmo-msc_10.42.42.6(pid=21261): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21261)] 16:13:55.072578 run osmo-msc_10.42.42.6(pid=21261): stdout: | (launched: 2022-12-09_16:13:53.851770) 16:13:55.125206 run osmo-msc_10.42.42.6(pid=21261): stderr: | [0;m[38;5;43m20221209161354178 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161354178 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa41f95dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161354178 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161354178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161354178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161354179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161354180 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161354181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161354181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161354181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:13:55.177975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21254): Terminating (SIGTERM) 16:13:55.220694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21257): Terminating (SIGTERM) 16:13:55.263630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21260): Terminating (SIGTERM) 16:13:55.306587 --- ParallelTerminationStrategy: PID 21254 died... 16:13:55.326917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21254): Terminated: ok {rc=0} 16:13:55.374170 --- ParallelTerminationStrategy: PID 21257 died... 16:13:55.394042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21257): Terminated: ok {rc=0} 16:13:55.440856 --- ParallelTerminationStrategy: PID 21260 died... 16:13:55.460864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21260): Terminated: ok {rc=0} 16:13:55.551790 bus /sierra_3: Setting Powered False 16:13:56.651591 bus /sierra_3: Setting Powered False 16:13:57.768245 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:13:58.915218 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:58.927374 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:13:58.995431 tst mo_mt_call_osmux.py: using LAC 22211 16:13:59.117352 tst mo_mt_call_osmux.py: using RAC 26 16:13:59.238249 tst mo_mt_call_osmux.py: using CellId 22211 16:13:59.357518 tst mo_mt_call_osmux.py: using BVCI 22212 16:13:59.468564 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:59.480000 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:59.491267 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:59.502494 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:59.513967 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:13:59.525304 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:13:59.647545 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:13:59.769648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:00.283559 run create_hlr_db(pid=21263): Launched 16:14:00.411141 bus /sierra_2: Setting Powered False 16:14:01.494923 run create_hlr_db(pid=21263): Terminated: ok {rc=0} 16:14:02.009334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21265): Launched 16:14:02.337390 run osmo-hlr_10.42.42.2(pid=21266): Launched 16:14:02.455638 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:02.989649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21268): Launched 16:14:03.299085 run osmo-stp_10.42.42.5(pid=21269): Launched 16:14:03.419161 run osmo-msc_10.42.42.6: Starting osmo-msc 16:14:03.976314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21271): Launched 16:14:04.285413 run osmo-msc_10.42.42.6(pid=21272): Launched 16:14:04.457257 run osmo-stp_10.42.42.5(pid=21269): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21269)] 16:14:04.586668 run osmo-stp_10.42.42.5(pid=21269): stdout: | (launched: 2022-12-09_16:14:03.241962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:04.716265 run osmo-stp_10.42.42.5(pid=21269): stderr: | [0;m[38;5;43m20221209161403417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161403418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161403418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161403418 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161403419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161403419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161403419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:04.843950 run osmo-stp_10.42.42.5(pid=21269): stdout: | (launched: 2022-12-09_16:14:03.241962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:04.966698 run osmo-stp_10.42.42.5(pid=21269): stderr: | [0;m[38;5;43m20221209161403417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161403418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161403418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161403418 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161403419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161403419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161403419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:05.113089 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21269): Process ended prematurely: osmo-stp_10.42.42.5(pid=21269) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21269)] [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:14:05.122210 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:14:05.148811 run osmo-hlr_10.42.42.2(pid=21266): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21266)] 16:14:05.196505 run osmo-hlr_10.42.42.2(pid=21266): stdout: | (launched: 2022-12-09_16:14:02.280113) 16:14:05.245818 run osmo-hlr_10.42.42.2(pid=21266): stderr: | [0;m[1;31m20221209161402459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161402459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161402459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161402459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161402459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161402459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161402471 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161402480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161402481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161402481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:05.314502 run osmo-msc_10.42.42.6(pid=21272): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21272)] 16:14:05.362109 run osmo-msc_10.42.42.6(pid=21272): stdout: | (launched: 2022-12-09_16:14:04.228346) 16:14:05.410784 run osmo-msc_10.42.42.6(pid=21272): stderr: | [0;m[38;5;43m20221209161404507 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161404507 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4f2f0a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161404507 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161404507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161404507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161404508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161404509 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161404510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161404510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161404510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:14:05.460086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21265): Terminating (SIGTERM) 16:14:05.499432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21268): Terminating (SIGTERM) 16:14:05.539116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21271): Terminating (SIGTERM) 16:14:05.579149 --- ParallelTerminationStrategy: PID 21265 died... 16:14:05.598218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21265): Terminated: ok {rc=0} 16:14:05.642267 --- ParallelTerminationStrategy: PID 21268 died... 16:14:05.660772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21268): Terminated: ok {rc=0} 16:14:05.704864 --- ParallelTerminationStrategy: PID 21271 died... 16:14:05.723801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21271): Terminated: ok {rc=0} 16:14:05.810121 bus /sierra_3: Setting Powered False 16:14:06.909291 bus /sierra_3: Setting Powered False 16:14:08.024730 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:14:09.273903 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:14:09.280398 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:14:09.313427 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:14:09.340420 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:14:09.391813 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:14:09.424361 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:14:09.451054 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:14:10.003397 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:14:10.053373 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:10.064781 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:14:10.132867 tst mo_mt_call.py: using LAC 22212 16:14:10.251684 tst mo_mt_call.py: using RAC 27 16:14:10.372513 tst mo_mt_call.py: using CellId 22212 16:14:10.491754 tst mo_mt_call.py: using BVCI 22213 16:14:10.604563 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:10.615777 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:10.626909 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:10.638080 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:10.649327 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:10.660431 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:14:10.779264 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:14:10.903319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:11.417270 run create_hlr_db(pid=21277): Launched 16:14:11.543586 bus /sierra_2: Setting Powered False 16:14:12.607902 run create_hlr_db(pid=21277): Terminated: ok {rc=0} 16:14:13.050027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21279): Launched 16:14:13.359933 run osmo-hlr_10.42.42.2(pid=21280): Launched 16:14:13.476900 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:14.007652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21282): Launched 16:14:14.318989 run osmo-stp_10.42.42.5(pid=21283): Launched 16:14:14.437897 run osmo-msc_10.42.42.6: Starting osmo-msc 16:14:14.995448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21285): Launched 16:14:15.306163 run osmo-msc_10.42.42.6(pid=21286): Launched 16:14:15.478780 run osmo-stp_10.42.42.5(pid=21283): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21283)] 16:14:15.608819 run osmo-stp_10.42.42.5(pid=21283): stdout: | (launched: 2022-12-09_16:14:14.260762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:15.738895 run osmo-stp_10.42.42.5(pid=21283): stderr: | [0;m[38;5;43m20221209161414433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161414433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161414434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161414434 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161414435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161414435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161414435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:15.875677 run osmo-stp_10.42.42.5(pid=21283): stdout: | (launched: 2022-12-09_16:14:14.260762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:16.001937 run osmo-stp_10.42.42.5(pid=21283): stderr: | [0;m[38;5;43m20221209161414433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161414433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161414434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161414434 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161414435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161414435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161414435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:16.151365 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21283): Process ended prematurely: osmo-stp_10.42.42.5(pid=21283) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21283)] [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:14:16.160828 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:14:16.188188 run osmo-hlr_10.42.42.2(pid=21280): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21280)] 16:14:16.237360 run osmo-hlr_10.42.42.2(pid=21280): stdout: | (launched: 2022-12-09_16:14:13.303051) 16:14:16.288051 run osmo-hlr_10.42.42.2(pid=21280): stderr: | [0;m[1;31m20221209161413483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161413483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161413483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161413483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161413483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161413484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161413507 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161413517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161413517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161413517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:16.358243 run osmo-msc_10.42.42.6(pid=21286): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21286)] 16:14:16.407168 run osmo-msc_10.42.42.6(pid=21286): stdout: | (launched: 2022-12-09_16:14:15.248699) 16:14:16.457667 run osmo-msc_10.42.42.6(pid=21286): stderr: | [0;m[38;5;43m20221209161415524 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161415524 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f83a5c68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161415524 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161415524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161415525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161415525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161415529 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161415530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161415530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161415530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:14:16.508533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21279): Terminating (SIGTERM) 16:14:16.549293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21282): Terminating (SIGTERM) 16:14:16.589762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21285): Terminating (SIGTERM) 16:14:16.630644 --- ParallelTerminationStrategy: PID 21279 died... 16:14:16.649849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21279): Terminated: ok {rc=0} 16:14:16.694920 --- ParallelTerminationStrategy: PID 21282 died... 16:14:16.714283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21282): Terminated: ok {rc=0} 16:14:16.759225 --- ParallelTerminationStrategy: PID 21285 died... 16:14:16.778400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21285): Terminated: ok {rc=0} 16:14:16.863864 bus /sierra_3: Setting Powered False 16:14:17.958938 bus /sierra_3: Setting Powered False 16:14:19.072504 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:14:20.223390 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:20.235932 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:14:20.309085 tst mo_mt_call_osmux.py: using LAC 22213 16:14:20.440186 tst mo_mt_call_osmux.py: using RAC 28 16:14:20.568926 tst mo_mt_call_osmux.py: using CellId 22213 16:14:20.697906 tst mo_mt_call_osmux.py: using BVCI 22214 16:14:20.817872 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:20.829715 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:20.841248 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:20.853494 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:20.865792 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:14:20.877903 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:14:21.002380 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:14:21.123920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:21.604362 run create_hlr_db(pid=21288): Launched 16:14:21.730895 bus /sierra_2: Setting Powered False 16:14:22.792149 run create_hlr_db(pid=21288): Terminated: ok {rc=0} 16:14:23.243521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21290): Launched 16:14:23.576178 run osmo-hlr_10.42.42.2(pid=21291): Launched 16:14:23.704229 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:24.270337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21293): Launched 16:14:24.602770 run osmo-stp_10.42.42.5(pid=21294): Launched 16:14:24.730566 run osmo-msc_10.42.42.6: Starting osmo-msc 16:14:25.327390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21296): Launched 16:14:25.657605 run osmo-msc_10.42.42.6(pid=21297): Launched 16:14:25.842500 run osmo-stp_10.42.42.5(pid=21294): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21294)] 16:14:25.980912 run osmo-stp_10.42.42.5(pid=21294): stdout: | (launched: 2022-12-09_16:14:24.542487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:26.119798 run osmo-stp_10.42.42.5(pid=21294): stderr: | [0;m[38;5;43m20221209161424735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161424736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161424736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161424736 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161424739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161424739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161424739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:26.257197 run osmo-stp_10.42.42.5(pid=21294): stdout: | (launched: 2022-12-09_16:14:24.542487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:26.388172 run osmo-stp_10.42.42.5(pid=21294): stderr: | [0;m[38;5;43m20221209161424735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161424736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161424736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161424736 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161424739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161424739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161424739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:26.544613 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21294): Process ended prematurely: osmo-stp_10.42.42.5(pid=21294) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21294)] [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:14:26.554548 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:14:26.583441 run osmo-hlr_10.42.42.2(pid=21291): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21291)] 16:14:26.633581 run osmo-hlr_10.42.42.2(pid=21291): stdout: | (launched: 2022-12-09_16:14:23.515638) 16:14:26.685442 run osmo-hlr_10.42.42.2(pid=21291): stderr: | [0;m[1;31m20221209161423716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161423716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161423716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161423716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161423716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161423716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161423729 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161423738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161423739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161423739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:26.757675 run osmo-msc_10.42.42.6(pid=21297): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21297)] 16:14:26.807862 run osmo-msc_10.42.42.6(pid=21297): stdout: | (launched: 2022-12-09_16:14:25.597304) 16:14:26.859489 run osmo-msc_10.42.42.6(pid=21297): stderr: | [0;m[38;5;43m20221209161425920 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161425920 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe292d8ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161425920 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161425920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161425920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161425921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161425922 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161425923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161425923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161425923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:14:26.911440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21290): Terminating (SIGTERM) 16:14:26.953470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21293): Terminating (SIGTERM) 16:14:26.995653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21296): Terminating (SIGTERM) 16:14:27.037965 --- ParallelTerminationStrategy: PID 21290 died... 16:14:27.057856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21290): Terminated: ok {rc=0} 16:14:27.104741 --- ParallelTerminationStrategy: PID 21293 died... 16:14:27.124466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21293): Terminated: ok {rc=0} 16:14:27.171064 --- ParallelTerminationStrategy: PID 21296 died... 16:14:27.190719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21296): Terminated: ok {rc=0} 16:14:27.277972 bus /sierra_3: Setting Powered False 16:14:28.375028 bus /sierra_3: Setting Powered False 16:14:29.489796 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:14:30.734835 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:14:30.741615 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:14:30.774192 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:14:30.801060 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:14:30.870078 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:14:30.925970 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:14:30.954554 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:14:31.479657 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:14:31.556059 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:31.572796 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:14:31.654871 tst mo_mt_call.py: using LAC 22214 16:14:31.781672 tst mo_mt_call.py: using RAC 29 16:14:31.937916 tst mo_mt_call.py: using CellId 22214 16:14:32.077134 tst mo_mt_call.py: using BVCI 22215 16:14:32.192886 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:32.204681 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:32.216209 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:32.228326 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:32.240187 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:32.253435 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:14:32.376144 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:14:32.493615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:32.970484 run create_hlr_db(pid=21304): Launched 16:14:33.099026 bus /sierra_2: Setting Powered False 16:14:34.160089 run create_hlr_db(pid=21304): Terminated: ok {rc=0} 16:14:34.611246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21306): Launched 16:14:34.944401 run osmo-hlr_10.42.42.2(pid=21307): Launched 16:14:35.070933 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:35.640907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21309): Launched 16:14:35.957010 run osmo-stp_10.42.42.5(pid=21310): Launched 16:14:36.074206 run osmo-msc_10.42.42.6: Starting osmo-msc 16:14:36.633128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21312): Launched 16:14:36.944389 run osmo-msc_10.42.42.6(pid=21313): Launched 16:14:37.117506 run osmo-stp_10.42.42.5(pid=21310): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21310)] 16:14:37.248672 run osmo-stp_10.42.42.5(pid=21310): stdout: | (launched: 2022-12-09_16:14:35.900052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:37.379725 run osmo-stp_10.42.42.5(pid=21310): stderr: | [0;m[38;5;43m20221209161436073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161436073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161436074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161436074 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161436074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161436075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161436075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:37.508739 run osmo-stp_10.42.42.5(pid=21310): stdout: | (launched: 2022-12-09_16:14:35.900052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:37.631507 run osmo-stp_10.42.42.5(pid=21310): stderr: | [0;m[38;5;43m20221209161436073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161436073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161436074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161436074 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161436074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161436075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161436075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:37.778112 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21310): Process ended prematurely: osmo-stp_10.42.42.5(pid=21310) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21310)] [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:14:37.787162 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:14:37.813788 run osmo-hlr_10.42.42.2(pid=21307): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21307)] 16:14:37.861654 run osmo-hlr_10.42.42.2(pid=21307): stdout: | (launched: 2022-12-09_16:14:34.883548) 16:14:37.911360 run osmo-hlr_10.42.42.2(pid=21307): stderr: | [0;m[1;31m20221209161435085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161435085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161435085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161435085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161435085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161435085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161435098 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161435108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161435108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161435108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:37.980553 run osmo-msc_10.42.42.6(pid=21313): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21313)] 16:14:38.028431 run osmo-msc_10.42.42.6(pid=21313): stdout: | (launched: 2022-12-09_16:14:36.886567) 16:14:38.077872 run osmo-msc_10.42.42.6(pid=21313): stderr: | [0;m[38;5;43m20221209161437158 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161437159 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa2c3ea5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161437159 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161437159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161437159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161437159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161437163 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161437163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161437163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161437163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:14:38.127519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21306): Terminating (SIGTERM) 16:14:38.167272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21309): Terminating (SIGTERM) 16:14:38.206965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21312): Terminating (SIGTERM) 16:14:38.247030 --- ParallelTerminationStrategy: PID 21306 died... 16:14:38.266109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21306): Terminated: ok {rc=0} 16:14:38.310175 --- ParallelTerminationStrategy: PID 21309 died... 16:14:38.328940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21309): Terminated: ok {rc=0} 16:14:38.372803 --- ParallelTerminationStrategy: PID 21312 died... 16:14:38.391849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21312): Terminated: ok {rc=0} 16:14:38.478864 bus /sierra_3: Setting Powered False 16:14:39.579875 bus /sierra_3: Setting Powered False 16:14:40.697396 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:14:41.845810 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:41.858187 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:14:41.928149 tst mo_mt_call_osmux.py: using LAC 22215 16:14:42.058570 tst mo_mt_call_osmux.py: using RAC 30 16:14:42.187154 tst mo_mt_call_osmux.py: using CellId 22215 16:14:42.317983 tst mo_mt_call_osmux.py: using BVCI 22216 16:14:42.437650 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:42.449328 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:42.460714 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:42.472498 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:42.484406 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:14:42.496182 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:14:42.618928 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:14:42.741376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:43.252717 run create_hlr_db(pid=21315): Launched 16:14:43.380651 bus /sierra_2: Setting Powered False 16:14:44.445773 run create_hlr_db(pid=21315): Terminated: ok {rc=0} 16:14:44.888190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21317): Launched 16:14:45.200631 run osmo-hlr_10.42.42.2(pid=21318): Launched 16:14:45.319677 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:45.870647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21320): Launched 16:14:46.217032 run osmo-stp_10.42.42.5(pid=21321): Launched 16:14:46.456620 run osmo-msc_10.42.42.6: Starting osmo-msc 16:14:47.225974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21323): Launched 16:14:47.563010 run osmo-msc_10.42.42.6(pid=21324): Launched 16:14:47.748413 run osmo-stp_10.42.42.5(pid=21321): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21321)] 16:14:47.887401 run osmo-stp_10.42.42.5(pid=21321): stdout: | (launched: 2022-12-09_16:14:46.159115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:48.027391 run osmo-stp_10.42.42.5(pid=21321): stderr: | [0;m[38;5;43m20221209161446489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161446489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161446490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161446490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161446492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161446492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161446497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:48.159907 run osmo-stp_10.42.42.5(pid=21321): stdout: | (launched: 2022-12-09_16:14:46.159115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:48.282946 run osmo-stp_10.42.42.5(pid=21321): stderr: | [0;m[38;5;43m20221209161446489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161446489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161446490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161446490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161446492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161446492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161446497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:48.430371 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21321): Process ended prematurely: osmo-stp_10.42.42.5(pid=21321) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21321)] [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:14:48.439535 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 16:14:48.466546 run osmo-hlr_10.42.42.2(pid=21318): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21318)] 16:14:48.514887 run osmo-hlr_10.42.42.2(pid=21318): stdout: | (launched: 2022-12-09_16:14:45.143511) 16:14:48.564669 run osmo-hlr_10.42.42.2(pid=21318): stderr: | [0;m[1;31m20221209161445320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161445321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161445321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161445321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161445321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161445321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161445334 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161445346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161445346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161445346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:48.634424 run osmo-msc_10.42.42.6(pid=21324): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21324)] 16:14:48.682268 run osmo-msc_10.42.42.6(pid=21324): stdout: | (launched: 2022-12-09_16:14:47.502272) 16:14:48.732045 run osmo-msc_10.42.42.6(pid=21324): stderr: | [0;m[38;5;43m20221209161447825 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161447825 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f09f2442c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161447825 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161447825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161447826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161447826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161447827 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161447828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161447828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161447828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:14:48.781759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21317): Terminating (SIGTERM) 16:14:48.821852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21320): Terminating (SIGTERM) 16:14:48.862056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21323): Terminating (SIGTERM) 16:14:48.902812 --- ParallelTerminationStrategy: PID 21317 died... 16:14:48.922215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21317): Terminated: ok {rc=0} 16:14:48.967130 --- ParallelTerminationStrategy: PID 21320 died... 16:14:48.986228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21320): Terminated: ok {rc=0} 16:14:49.030563 --- ParallelTerminationStrategy: PID 21323 died... 16:14:49.049588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21323): Terminated: ok {rc=0} 16:14:49.136442 bus /sierra_3: Setting Powered False 16:14:50.236176 bus /sierra_3: Setting Powered False 16:14:51.352726 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:14:52.606708 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:14:52.613459 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:14:52.645711 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:14:52.672343 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:14:52.724331 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:14:52.756345 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:14:52.782803 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:14:53.335881 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:14:53.385564 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:53.396721 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:14:53.465681 tst mo_mt_call.py: using LAC 22216 16:14:53.588368 tst mo_mt_call.py: using RAC 31 16:14:53.710850 tst mo_mt_call.py: using CellId 22216 16:14:53.833358 tst mo_mt_call.py: using BVCI 22217 16:14:53.944762 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:53.956028 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:53.967196 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:53.978303 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:53.989464 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:14:54.000525 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:14:54.121212 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:14:54.241352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:54.719473 run create_hlr_db(pid=21329): Launched 16:14:54.845462 bus /sierra_2: Setting Powered False 16:14:55.906481 run create_hlr_db(pid=21329): Terminated: ok {rc=0} 16:14:56.336886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21331): Launched 16:14:56.646690 run osmo-hlr_10.42.42.2(pid=21332): Launched 16:14:56.764632 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:57.308464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21334): Launched 16:14:57.618522 run osmo-stp_10.42.42.5(pid=21335): Launched 16:14:57.735950 run osmo-msc_10.42.42.6: Starting osmo-msc 16:14:58.294589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21337): Launched 16:14:58.605886 run osmo-msc_10.42.42.6(pid=21338): Launched 16:14:58.777646 run osmo-stp_10.42.42.5(pid=21335): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21335)] 16:14:58.907328 run osmo-stp_10.42.42.5(pid=21335): stdout: | (launched: 2022-12-09_16:14:57.561742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:59.037410 run osmo-stp_10.42.42.5(pid=21335): stderr: | [0;m[38;5;43m20221209161457732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161457732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161457732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161457733 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161457733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161457733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161457733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:59.165684 run osmo-stp_10.42.42.5(pid=21335): stdout: | (launched: 2022-12-09_16:14:57.561742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:59.287878 run osmo-stp_10.42.42.5(pid=21335): stderr: | [0;m[38;5;43m20221209161457732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161457732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161457732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161457733 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161457733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161457733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161457733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:59.435177 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21335): Process ended prematurely: osmo-stp_10.42.42.5(pid=21335) [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21335)] [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:14:59.443940 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:14:59.470326 run osmo-hlr_10.42.42.2(pid=21332): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21332)] 16:14:59.517741 run osmo-hlr_10.42.42.2(pid=21332): stdout: | (launched: 2022-12-09_16:14:56.589894) 16:14:59.566805 run osmo-hlr_10.42.42.2(pid=21332): stderr: | [0;m[1;31m20221209161456769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161456770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161456770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161456770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161456770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161456770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161456782 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161456791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161456791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161456791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:59.635438 run osmo-msc_10.42.42.6(pid=21338): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21338)] 16:14:59.682758 run osmo-msc_10.42.42.6(pid=21338): stdout: | (launched: 2022-12-09_16:14:58.548669) 16:14:59.731796 run osmo-msc_10.42.42.6(pid=21338): stderr: | [0;m[38;5;43m20221209161458820 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161458821 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5f382d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161458821 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161458821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161458821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161458821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161458823 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161458823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161458823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161458824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:14:59.781168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21331): Terminating (SIGTERM) 16:14:59.820589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21334): Terminating (SIGTERM) 16:14:59.860064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21337): Terminating (SIGTERM) 16:14:59.899710 --- ParallelTerminationStrategy: PID 21331 died... 16:14:59.918797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21331): Terminated: ok {rc=0} 16:14:59.962498 --- ParallelTerminationStrategy: PID 21334 died... 16:14:59.980983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21334): Terminated: ok {rc=0} 16:15:00.024571 --- ParallelTerminationStrategy: PID 21337 died... 16:15:00.043228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21337): Terminated: ok {rc=0} 16:15:00.127913 bus /sierra_3: Setting Powered False 16:15:01.236534 bus /sierra_3: Setting Powered False 16:15:02.367019 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:15:03.514528 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:15:03.526949 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:15:03.605953 tst mo_mt_call_osmux.py: using LAC 22217 16:15:03.734798 tst mo_mt_call_osmux.py: using RAC 32 16:15:03.861888 tst mo_mt_call_osmux.py: using CellId 22217 16:15:03.989227 tst mo_mt_call_osmux.py: using BVCI 22218 16:15:04.109028 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:15:04.121049 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:15:04.132828 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:15:04.144736 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:15:04.156666 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:15:04.168621 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:15:04.286676 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:15:04.411008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:04.891407 run create_hlr_db(pid=21343): Launched 16:15:05.017814 bus /sierra_2: Setting Powered False 16:15:06.079219 run create_hlr_db(pid=21343): Terminated: ok {rc=0} 16:15:06.531220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21345): Launched 16:15:06.864653 run osmo-hlr_10.42.42.2(pid=21346): Launched 16:15:06.990608 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:07.562003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21349): Launched 16:15:07.895606 run osmo-stp_10.42.42.5(pid=21350): Launched 16:15:08.025054 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:08.624041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21352): Launched 16:15:08.957070 run osmo-msc_10.42.42.6(pid=21353): Launched 16:15:09.142712 run osmo-stp_10.42.42.5(pid=21350): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21350)] 16:15:09.281883 run osmo-stp_10.42.42.5(pid=21350): stdout: | (launched: 2022-12-09_16:15:07.834772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:09.422361 run osmo-stp_10.42.42.5(pid=21350): stderr: | [0;m[38;5;43m20221209161508028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161508028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161508028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161508029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161508029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161508029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161508029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:09.560178 run osmo-stp_10.42.42.5(pid=21350): stdout: | (launched: 2022-12-09_16:15:07.834772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:09.691277 run osmo-stp_10.42.42.5(pid=21350): stderr: | [0;m[38;5;43m20221209161508028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161508028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161508028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161508029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161508029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161508029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161508029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:09.848398 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21350): Process ended prematurely: osmo-stp_10.42.42.5(pid=21350) [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21350)] [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:15:09.858096 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:15:09.886456 run osmo-hlr_10.42.42.2(pid=21346): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21346)] 16:15:09.936757 run osmo-hlr_10.42.42.2(pid=21346): stdout: | (launched: 2022-12-09_16:15:06.803584) 16:15:09.988703 run osmo-hlr_10.42.42.2(pid=21346): stderr: | [0;m[1;31m20221209161507004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161507004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161507004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161507005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161507005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161507005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161507017 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161507026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161507026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161507026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:10.060841 run osmo-msc_10.42.42.6(pid=21353): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21353)] 16:15:10.110785 run osmo-msc_10.42.42.6(pid=21353): stdout: | (launched: 2022-12-09_16:15:08.896003) 16:15:10.162719 run osmo-msc_10.42.42.6(pid=21353): stderr: | [0;m[38;5;43m20221209161509219 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161509220 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f69d9b87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161509220 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161509220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161509220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161509220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161509222 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161509222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161509222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161509222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:10.214764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21345): Terminating (SIGTERM) 16:15:10.256465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21349): Terminating (SIGTERM) 16:15:10.298887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21352): Terminating (SIGTERM) 16:15:10.341300 --- ParallelTerminationStrategy: PID 21345 died... 16:15:10.361397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21345): Terminated: ok {rc=0} 16:15:10.408223 --- ParallelTerminationStrategy: PID 21349 died... 16:15:10.427950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21349): Terminated: ok {rc=0} 16:15:10.474480 --- ParallelTerminationStrategy: PID 21352 died... 16:15:10.493931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21352): Terminated: ok {rc=0} 16:15:10.582426 bus /sierra_3: Setting Powered False 16:15:11.682101 bus /sierra_3: Setting Powered False 16:15:12.798223 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:15:14.052688 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:15:14.059083 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:15:14.093563 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:15:14.121221 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:15:14.175945 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:15:14.209852 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:15:14.237306 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:15:14.785917 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:15:14.839136 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:14.850626 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:15:14.923086 tst mo_mt_call.py: using LAC 22218 16:15:15.052411 tst mo_mt_call.py: using RAC 33 16:15:15.181260 tst mo_mt_call.py: using CellId 22218 16:15:15.311613 tst mo_mt_call.py: using BVCI 22219 16:15:15.430957 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:15.442362 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:15.453609 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:15.465203 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:15.476689 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:15.488275 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:15:15.608238 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:15:15.730009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:16.332999 run create_hlr_db(pid=21358): Launched 16:15:16.471994 bus /sierra_2: Setting Powered False 16:15:17.536810 run create_hlr_db(pid=21358): Terminated: ok {rc=0} 16:15:18.005688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21360): Launched 16:15:18.338263 run osmo-hlr_10.42.42.2(pid=21361): Launched 16:15:18.465421 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:19.032784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21363): Launched 16:15:19.364869 run osmo-stp_10.42.42.5(pid=21364): Launched 16:15:19.492050 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:20.088266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21366): Launched 16:15:20.421710 run osmo-msc_10.42.42.6(pid=21367): Launched 16:15:20.606713 run osmo-stp_10.42.42.5(pid=21364): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21364)] 16:15:20.745331 run osmo-stp_10.42.42.5(pid=21364): stdout: | (launched: 2022-12-09_16:15:19.304099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:20.884751 run osmo-stp_10.42.42.5(pid=21364): stderr: | [0;m[38;5;43m20221209161519496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161519497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161519497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161519498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161519500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161519500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161519500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:21.023338 run osmo-stp_10.42.42.5(pid=21364): stdout: | (launched: 2022-12-09_16:15:19.304099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:21.154183 run osmo-stp_10.42.42.5(pid=21364): stderr: | [0;m[38;5;43m20221209161519496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161519497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161519497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161519498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161519500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161519500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161519500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:21.311593 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21364): Process ended prematurely: osmo-stp_10.42.42.5(pid=21364) [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21364)] [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:15:21.321106 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:15:21.349066 run osmo-hlr_10.42.42.2(pid=21361): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21361)] 16:15:21.399476 run osmo-hlr_10.42.42.2(pid=21361): stdout: | (launched: 2022-12-09_16:15:18.277565) 16:15:21.451574 run osmo-hlr_10.42.42.2(pid=21361): stderr: | [0;m[1;31m20221209161518477 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161518478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161518478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161518478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161518478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161518478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161518490 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161518498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161518499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161518499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:21.524104 run osmo-msc_10.42.42.6(pid=21367): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21367)] 16:15:21.574612 run osmo-msc_10.42.42.6(pid=21367): stdout: | (launched: 2022-12-09_16:15:20.360932) 16:15:21.626508 run osmo-msc_10.42.42.6(pid=21367): stderr: | [0;m[38;5;43m20221209161520684 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161520684 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f06eca51c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161520684 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161520684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161520684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161520685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161520686 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161520687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161520687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161520687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:21.678747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21360): Terminating (SIGTERM) 16:15:21.720622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21363): Terminating (SIGTERM) 16:15:21.762656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21366): Terminating (SIGTERM) 16:15:21.804913 --- ParallelTerminationStrategy: PID 21360 died... 16:15:21.825118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21360): Terminated: ok {rc=0} 16:15:21.872095 --- ParallelTerminationStrategy: PID 21363 died... 16:15:21.892164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21363): Terminated: ok {rc=0} 16:15:21.939552 --- ParallelTerminationStrategy: PID 21366 died... 16:15:21.959340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21366): Terminated: ok {rc=0} 16:15:22.047792 bus /sierra_3: Setting Powered False 16:15:23.148251 bus /sierra_3: Setting Powered False 16:15:24.265159 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:15:25.412807 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:25.424913 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:15:25.496221 tst mo_mt_call_osmux.py: using LAC 22219 16:15:25.620095 tst mo_mt_call_osmux.py: using RAC 34 16:15:25.742867 tst mo_mt_call_osmux.py: using CellId 22219 16:15:25.864836 tst mo_mt_call_osmux.py: using BVCI 22220 16:15:25.978438 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:25.989625 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:26.000770 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:26.011836 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:26.022923 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:15:26.034018 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:15:26.155406 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:15:26.278400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:26.793289 run create_hlr_db(pid=21369): Launched 16:15:26.920305 bus /sierra_2: Setting Powered False 16:15:27.986040 run create_hlr_db(pid=21369): Terminated: ok {rc=0} 16:15:28.428180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21371): Launched 16:15:28.740246 run osmo-hlr_10.42.42.2(pid=21372): Launched 16:15:28.857940 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:29.405677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21374): Launched 16:15:29.716373 run osmo-stp_10.42.42.5(pid=21375): Launched 16:15:29.834608 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:30.399467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21377): Launched 16:15:30.711822 run osmo-msc_10.42.42.6(pid=21378): Launched 16:15:30.990210 run osmo-stp_10.42.42.5(pid=21375): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21375)] 16:15:31.210865 run osmo-stp_10.42.42.5(pid=21375): stdout: | (launched: 2022-12-09_16:15:29.659385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:31.355030 run osmo-stp_10.42.42.5(pid=21375): stderr: | [0;m[38;5;43m20221209161529833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161529833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161529834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161529834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161529835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161529835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161529835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:31.500842 run osmo-stp_10.42.42.5(pid=21375): stdout: | (launched: 2022-12-09_16:15:29.659385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:31.637929 run osmo-stp_10.42.42.5(pid=21375): stderr: | [0;m[38;5;43m20221209161529833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161529833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161529834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161529834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161529835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161529835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161529835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:31.802080 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21375): Process ended prematurely: osmo-stp_10.42.42.5(pid=21375) [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21375)] [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:15:31.812640 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:15:31.844275 run osmo-hlr_10.42.42.2(pid=21372): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21372)] 16:15:31.898087 run osmo-hlr_10.42.42.2(pid=21372): stdout: | (launched: 2022-12-09_16:15:28.682465) 16:15:31.955426 run osmo-hlr_10.42.42.2(pid=21372): stderr: | [0;m[1;31m20221209161528860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161528860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161528860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161528860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161528860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161528860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161528873 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161528882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161528883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161528883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:32.031347 run osmo-msc_10.42.42.6(pid=21378): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21378)] 16:15:32.084920 run osmo-msc_10.42.42.6(pid=21378): stdout: | (launched: 2022-12-09_16:15:30.654786) 16:15:32.140669 run osmo-msc_10.42.42.6(pid=21378): stderr: | [0;m[38;5;43m20221209161530971 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161530971 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fda65218c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161530971 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161530971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161530972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161530972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161530974 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161530974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161530974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161530974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:32.196488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21371): Terminating (SIGTERM) 16:15:32.240215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21374): Terminating (SIGTERM) 16:15:32.283912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21377): Terminating (SIGTERM) 16:15:32.327028 --- ParallelTerminationStrategy: PID 21371 died... 16:15:32.347118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21371): Terminated: ok {rc=0} 16:15:32.395390 --- ParallelTerminationStrategy: PID 21374 died... 16:15:32.415264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21374): Terminated: ok {rc=0} 16:15:32.462116 --- ParallelTerminationStrategy: PID 21377 died... 16:15:32.481916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21377): Terminated: ok {rc=0} 16:15:32.570428 bus /sierra_3: Setting Powered False 16:15:33.671567 bus /sierra_3: Setting Powered False 16:15:34.788371 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:15:36.039438 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:15:36.046195 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:15:36.079783 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 16:15:36.107056 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 16:15:36.158967 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:15:36.192375 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 16:15:36.219863 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 16:15:36.776612 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 16:15:36.830137 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:36.842099 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:15:36.893457 tst mo_mt_call.py: using LAC 22220 16:15:37.021891 tst mo_mt_call.py: using RAC 35 16:15:37.148882 tst mo_mt_call.py: using CellId 22220 16:15:37.278490 tst mo_mt_call.py: using BVCI 22221 16:15:37.399754 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:37.411657 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:37.423311 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:37.435122 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:37.447033 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:37.459104 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:15:37.577818 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:15:37.699836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:38.212539 run create_hlr_db(pid=21385): Launched 16:15:38.338845 bus /sierra_2: Setting Powered False 16:15:39.403169 run create_hlr_db(pid=21385): Terminated: ok {rc=0} 16:15:39.844543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21387): Launched 16:15:40.170948 run osmo-hlr_10.42.42.2(pid=21388): Launched 16:15:40.299296 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:40.867556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21390): Launched 16:15:41.199887 run osmo-stp_10.42.42.5(pid=21391): Launched 16:15:41.327643 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:41.927201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21393): Launched 16:15:42.259923 run osmo-msc_10.42.42.6(pid=21394): Launched 16:15:42.446308 run osmo-stp_10.42.42.5(pid=21391): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21391)] 16:15:42.584907 run osmo-stp_10.42.42.5(pid=21391): stdout: | (launched: 2022-12-09_16:15:41.139463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:42.724119 run osmo-stp_10.42.42.5(pid=21391): stderr: | [0;m[38;5;43m20221209161541331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161541332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161541332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161541332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161541333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161541333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161541333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:42.862713 run osmo-stp_10.42.42.5(pid=21391): stdout: | (launched: 2022-12-09_16:15:41.139463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:42.993514 run osmo-stp_10.42.42.5(pid=21391): stderr: | [0;m[38;5;43m20221209161541331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161541332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161541332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161541332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161541333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161541333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161541333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:43.150815 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21391): Process ended prematurely: osmo-stp_10.42.42.5(pid=21391) [trial-2361↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21391)] [trial-2361↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 16:15:43.160313 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:15:43.188591 run osmo-hlr_10.42.42.2(pid=21388): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21388)] 16:15:43.238851 run osmo-hlr_10.42.42.2(pid=21388): stdout: | (launched: 2022-12-09_16:15:40.110644) 16:15:43.290777 run osmo-hlr_10.42.42.2(pid=21388): stderr: | [0;m[1;31m20221209161540308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161540308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161540308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161540308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161540308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161540308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161540323 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161540333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161540333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161540334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:43.363429 run osmo-msc_10.42.42.6(pid=21394): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21394)] 16:15:43.413288 run osmo-msc_10.42.42.6(pid=21394): stdout: | (launched: 2022-12-09_16:15:42.199612) 16:15:43.465175 run osmo-msc_10.42.42.6(pid=21394): stderr: | [0;m[38;5;43m20221209161542522 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161542522 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f422ac24c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161542522 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161542522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161542523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161542523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161542524 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161542525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161542525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161542525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:43.517340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21387): Terminating (SIGTERM) 16:15:43.559407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21390): Terminating (SIGTERM) 16:15:43.601481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21393): Terminating (SIGTERM) 16:15:43.643884 --- ParallelTerminationStrategy: PID 21387 died... 16:15:43.663886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21387): Terminated: ok {rc=0} 16:15:43.711021 --- ParallelTerminationStrategy: PID 21390 died... 16:15:43.730622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21390): Terminated: ok {rc=0} 16:15:43.777171 --- ParallelTerminationStrategy: PID 21393 died... 16:15:43.796534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21393): Terminated: ok {rc=0} 16:15:43.883943 bus /sierra_3: Setting Powered False 16:15:44.982885 bus /sierra_3: Setting Powered False 16:15:46.106930 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 16:15:47.268762 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:47.281207 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:15:47.333759 tst mo_mt_call_osmux.py: using LAC 22221 16:15:47.454943 tst mo_mt_call_osmux.py: using RAC 36 16:15:47.577875 tst mo_mt_call_osmux.py: using CellId 22221 16:15:47.700468 tst mo_mt_call_osmux.py: using BVCI 22222 16:15:47.813970 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:47.825519 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:47.836643 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:47.847830 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:47.859179 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:15:47.870382 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:15:47.988468 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:15:48.112805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:48.625729 run create_hlr_db(pid=21396): Launched 16:15:48.752148 bus /sierra_2: Setting Powered False 16:15:49.817690 run create_hlr_db(pid=21396): Terminated: ok {rc=0} 16:15:50.261292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21398): Launched 16:15:50.573811 run osmo-hlr_10.42.42.2(pid=21399): Launched 16:15:50.693839 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:51.239732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21401): Launched 16:15:51.550313 run osmo-stp_10.42.42.5(pid=21402): Launched 16:15:51.669517 run osmo-msc_10.42.42.6: Starting osmo-msc 16:15:52.244429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21404): Launched 16:15:52.556088 run osmo-msc_10.42.42.6(pid=21405): Launched 16:15:52.730185 run osmo-stp_10.42.42.5(pid=21402): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21402)] 16:15:52.860713 run osmo-stp_10.42.42.5(pid=21402): stdout: | (launched: 2022-12-09_16:15:51.493263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:52.990931 run osmo-stp_10.42.42.5(pid=21402): stderr: | [0;m[38;5;43m20221209161551666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161551666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161551666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161551667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161551667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161551667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161551667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:53.119389 run osmo-stp_10.42.42.5(pid=21402): stdout: | (launched: 2022-12-09_16:15:51.493263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:53.241522 run osmo-stp_10.42.42.5(pid=21402): stderr: | [0;m[38;5;43m20221209161551666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161551666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161551666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161551667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161551667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161551667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161551667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:53.388710 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21402): Process ended prematurely: osmo-stp_10.42.42.5(pid=21402) [trial-2361↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21402)] [trial-2361↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 16:15:53.397693 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:15:53.424004 run osmo-hlr_10.42.42.2(pid=21399): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21399)] 16:15:53.471585 run osmo-hlr_10.42.42.2(pid=21399): stdout: | (launched: 2022-12-09_16:15:50.516286) 16:15:53.521047 run osmo-hlr_10.42.42.2(pid=21399): stderr: | [0;m[1;31m20221209161550693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161550693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161550693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161550693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161550693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161550693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161550705 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161550713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161550713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161550713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:53.589773 run osmo-msc_10.42.42.6(pid=21405): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21405)] 16:15:53.637170 run osmo-msc_10.42.42.6(pid=21405): stdout: | (launched: 2022-12-09_16:15:52.498505) 16:15:53.686254 run osmo-msc_10.42.42.6(pid=21405): stderr: | [0;m[38;5;43m20221209161552772 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161552772 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ce43f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161552773 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161552773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161552773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161552773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161552775 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161552775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161552775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161552775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:15:53.735938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21398): Terminating (SIGTERM) 16:15:53.775816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21401): Terminating (SIGTERM) 16:15:53.815742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21404): Terminating (SIGTERM) 16:15:53.855478 --- ParallelTerminationStrategy: PID 21398 died... 16:15:53.874443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21398): Terminated: ok {rc=0} 16:15:53.917955 --- ParallelTerminationStrategy: PID 21401 died... 16:15:53.936364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21401): Terminated: ok {rc=0} 16:15:53.979580 --- ParallelTerminationStrategy: PID 21404 died... 16:15:53.998042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21404): Terminated: ok {rc=0} 16:15:54.082750 bus /sierra_3: Setting Powered False 16:15:55.184145 bus /sierra_3: Setting Powered False 16:15:56.300003 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 emergency:trx-umtrx --------------------------------------------------------------------- 16:15:57.555628 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:15:57.561444 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:15:57.596362 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:15:57.624573 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 16:15:57.711246 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:15:57.743883 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:15:57.770666 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 16:15:58.355664 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2361 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 16:15:58.361057 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:15:58.371948 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 16:15:58.420746 tst emergency_mo_mt_call.py: using LAC 22222 16:15:58.538329 tst emergency_mo_mt_call.py: using RAC 37 16:15:58.657050 tst emergency_mo_mt_call.py: using CellId 22222 16:15:58.773581 tst emergency_mo_mt_call.py: using BVCI 22223 16:15:58.883099 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:15:58.894018 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:15:58.904707 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:15:58.915432 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:15:58.926163 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:15:58.937094 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:15:59.056567 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:15:59.179497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:59.684446 run create_hlr_db(pid=21410): Launched 16:15:59.810624 bus /sierra_2: Setting Powered False 16:16:00.880626 run create_hlr_db(pid=21410): Terminated: ok {rc=0} 16:16:01.380514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21412): Launched 16:16:01.733010 run osmo-hlr_10.42.42.2(pid=21413): Launched 16:16:02.009391 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:02.686986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21415): Launched 16:16:02.992889 run osmo-stp_10.42.42.5(pid=21416): Launched 16:16:03.119222 tst emergency_mo_mt_call.py: using MSISDN 7265 16:16:03.274174 run osmo-msc_10.42.42.6: Starting osmo-msc 16:16:03.821143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21418): Launched 16:16:04.128906 run osmo-msc_10.42.42.6(pid=21419): Launched 16:16:04.300216 run osmo-stp_10.42.42.5(pid=21416): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21416)] 16:16:04.429753 run osmo-stp_10.42.42.5(pid=21416): stdout: | (launched: 2022-12-09_16:16:02.936304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:04.558540 run osmo-stp_10.42.42.5(pid=21416): stderr: | [0;m[38;5;43m20221209161603108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161603108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161603108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161603109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161603109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161603109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161603109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:04.685664 run osmo-stp_10.42.42.5(pid=21416): stdout: | (launched: 2022-12-09_16:16:02.936304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:04.807638 run osmo-stp_10.42.42.5(pid=21416): stderr: | [0;m[38;5;43m20221209161603108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161603108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161603108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161603109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161603109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161603109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161603109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:04.953393 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=21416): Process ended prematurely: osmo-stp_10.42.42.5(pid=21416) [trial-2361↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21416)] [trial-2361↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 16:16:04.961867 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 16:16:04.988164 run osmo-hlr_10.42.42.2(pid=21413): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21413)] 16:16:05.036145 run osmo-hlr_10.42.42.2(pid=21413): stdout: | (launched: 2022-12-09_16:16:01.673795) 16:16:05.085796 run osmo-hlr_10.42.42.2(pid=21413): stderr: | [0;m[1;31m20221209161601931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161601931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161601931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161601931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161601931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161601931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161601945 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161601985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161601986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161601986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:05.154851 run osmo-msc_10.42.42.6(pid=21419): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21419)] 16:16:05.202599 run osmo-msc_10.42.42.6(pid=21419): stdout: | (launched: 2022-12-09_16:16:04.072136) 16:16:05.251881 run osmo-msc_10.42.42.6(pid=21419): stderr: | [0;m[38;5;43m20221209161604347 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161604347 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4d4342bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161604348 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161604348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161604348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161604348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161604351 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161604351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161604351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161604351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:16:05.301488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21412): Terminating (SIGTERM) 16:16:05.341238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21415): Terminating (SIGTERM) 16:16:05.381112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21418): Terminating (SIGTERM) 16:16:05.421296 --- ParallelTerminationStrategy: PID 21412 died... 16:16:05.440556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21412): Terminated: ok {rc=0} 16:16:05.484663 --- ParallelTerminationStrategy: PID 21415 died... 16:16:05.503421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21415): Terminated: ok {rc=0} 16:16:05.547390 --- ParallelTerminationStrategy: PID 21418 died... 16:16:05.566019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21418): Terminated: ok {rc=0} 16:16:05.652006 bus /sierra_3: Setting Powered False 16:16:06.752284 bus /sierra_3: Setting Powered False 16:16:07.868238 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 16:16:08.956627 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:16:08.968481 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 16:16:09.023440 tst emergency_preemptive_call.py: using LAC 22223 16:16:09.142148 tst emergency_preemptive_call.py: using RAC 38 16:16:09.259011 tst emergency_preemptive_call.py: using CellId 22223 16:16:09.375578 tst emergency_preemptive_call.py: using BVCI 22224 16:16:09.484742 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:16:09.495504 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:16:09.506119 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:16:09.516759 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:16:09.527481 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:16:09.538165 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:09.659427 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:09.778450 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:09.894618 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:10.015166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:10.490720 run create_hlr_db(pid=21421): Launched 16:16:10.617799 bus /sierra_2: Setting Powered False 16:16:11.678513 run create_hlr_db(pid=21421): Terminated: ok {rc=0} 16:16:12.126080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21423): Launched 16:16:12.453392 run osmo-hlr_10.42.42.2(pid=21424): Launched 16:16:12.578069 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:13.141991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21426): Launched 16:16:13.468753 run osmo-stp_10.42.42.5(pid=21427): Launched 16:16:13.605034 tst emergency_preemptive_call.py: using MSISDN 7266 16:16:13.775623 run osmo-msc_10.42.42.6: Starting osmo-msc 16:16:14.359240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21429): Launched 16:16:14.686564 run osmo-msc_10.42.42.6(pid=21430): Launched 16:16:14.869814 run osmo-stp_10.42.42.5(pid=21427): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21427)] 16:16:15.007102 run osmo-stp_10.42.42.5(pid=21427): stdout: | (launched: 2022-12-09_16:16:13.408813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:15.145282 run osmo-stp_10.42.42.5(pid=21427): stderr: | [0;m[38;5;43m20221209161613605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161613605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161613605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161613605 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161613606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161613606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161613606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:15.282320 run osmo-stp_10.42.42.5(pid=21427): stdout: | (launched: 2022-12-09_16:16:13.408813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:15.413091 run osmo-stp_10.42.42.5(pid=21427): stderr: | [0;m[38;5;43m20221209161613605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161613605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161613605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161613605 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161613606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161613606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161613606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:15.568325 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21427): Process ended prematurely: osmo-stp_10.42.42.5(pid=21427) [trial-2361↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21427)] [trial-2361↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 16:16:15.577333 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 16:16:15.605338 run osmo-hlr_10.42.42.2(pid=21424): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21424)] 16:16:15.655851 run osmo-hlr_10.42.42.2(pid=21424): stdout: | (launched: 2022-12-09_16:16:12.393700) 16:16:15.707990 run osmo-hlr_10.42.42.2(pid=21424): stderr: | [0;m[1;31m20221209161612595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161612595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161612595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161612595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161612595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161612595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161612607 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161612615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161612616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161612616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:15.780865 run osmo-msc_10.42.42.6(pid=21430): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21430)] 16:16:15.836363 run osmo-msc_10.42.42.6(pid=21430): stdout: | (launched: 2022-12-09_16:16:14.626574) 16:16:15.895280 run osmo-msc_10.42.42.6(pid=21430): stderr: | [0;m[38;5;43m20221209161614951 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209161614952 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2c7817ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209161614952 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209161614952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209161614952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209161614952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209161614954 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209161614954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209161614954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209161614954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:16:15.958831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21423): Terminating (SIGTERM) 16:16:16.003585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21426): Terminating (SIGTERM) 16:16:16.055031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21429): Terminating (SIGTERM) 16:16:16.100009 --- ParallelTerminationStrategy: PID 21423 died... 16:16:16.119874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21423): Terminated: ok {rc=0} 16:16:16.168661 --- ParallelTerminationStrategy: PID 21426 died... 16:16:16.188201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21426): Terminated: ok {rc=0} 16:16:16.234431 --- ParallelTerminationStrategy: PID 21429 died... 16:16:16.254082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21429): Terminated: ok {rc=0} 16:16:16.347451 bus /sierra_9: Setting Powered False 16:16:17.456375 bus /sierra_9: Setting Powered False 16:16:18.572429 bus /sierra_8: Setting Powered False 16:16:19.671746 bus /sierra_8: Setting Powered False 16:16:20.787791 bus /sierra_3: Setting Powered False 16:16:21.887218 bus /sierra_3: Setting Powered False 16:16:23.003504 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-umtrx --------------------------------------------------------------------- 16:16:24.278869 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:16:24.283253 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:16:24.315651 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 16:16:24.354103 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 16:16:24.440754 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:16:24.473140 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 16:16:24.511491 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 16:16:25.101604 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 16:16:25.152179 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:25.162871 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:16:25.212588 tst cs_paging_gprs_active.py: using LAC 22224 16:16:25.334980 tst cs_paging_gprs_active.py: using RAC 39 16:16:25.458399 tst cs_paging_gprs_active.py: using CellId 22224 16:16:25.581209 tst cs_paging_gprs_active.py: using BVCI 22225 16:16:25.694407 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:25.705237 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:25.715613 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:25.726135 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:25.736417 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:25.746769 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:25.757325 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:25.767609 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:25.778116 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:25.900091 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:26.019985 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:16:26.230528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:16:26.542017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21435): Launched 16:16:26.814471 run iperf3-srv_10.42.42.10(pid=21436): Launched 16:16:26.932683 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:16:27.141494 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:16:27.457852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21437): Launched 16:16:27.734934 run iperf3-srv_10.42.42.10(pid=21438): Launched 16:16:27.851318 tst cs_paging_gprs_active.py:38: start network... 16:16:28.059770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:28.542201 run create_hlr_db(pid=21439): Launched 16:16:28.669939 bus /sierra_2: Setting Powered False 16:16:29.731633 run create_hlr_db(pid=21439): Terminated: ok {rc=0} 16:16:30.187367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21441): Launched 16:16:30.522153 run osmo-hlr_10.42.42.2(pid=21442): Launched 16:16:30.651149 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:31.254045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21444): Launched 16:16:31.589274 run osmo-stp_10.42.42.5(pid=21445): Launched 16:16:31.730159 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:16:32.373828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21447): Launched 16:16:32.504275 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:16:32.786226 run patchelf(pid=21448): Launched 16:16:32.972147 run osmo-stp_10.42.42.5(pid=21445): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21445)] 16:16:33.113192 run osmo-stp_10.42.42.5(pid=21445): stdout: | (launched: 2022-12-09_16:16:31.529259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:33.256043 run osmo-stp_10.42.42.5(pid=21445): stderr: | [0;m[38;5;43m20221209161631915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161631915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161631915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161631916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161631923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161631923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161631923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:33.399517 run osmo-stp_10.42.42.5(pid=21445): stdout: | (launched: 2022-12-09_16:16:31.529259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:33.535714 run osmo-stp_10.42.42.5(pid=21445): stderr: | [0;m[38;5;43m20221209161631915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161631915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161631915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161631916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161631923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161631923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161631923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:33.697533 run patchelf(pid=21448): Terminating (SIGINT) 16:16:33.884725 run patchelf(pid=21448): Terminated: ok {rc=0} 16:16:34.019918 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21445): Process ended prematurely: osmo-stp_10.42.42.5(pid=21445) [trial-2361↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21445)] [trial-2361↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 16:16:34.030429 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 16:16:34.059993 run osmo-hlr_10.42.42.2(pid=21442): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21442)] 16:16:34.111124 run osmo-hlr_10.42.42.2(pid=21442): stdout: | (launched: 2022-12-09_16:16:30.460882) 16:16:34.163785 run osmo-hlr_10.42.42.2(pid=21442): stderr: | [0;m[1;31m20221209161630663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161630663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161630663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161630663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161630663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161630664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161630675 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161630684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161630684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161630684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:34.216447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21435): Terminating (SIGTERM) 16:16:34.258950 run iperf3-srv_10.42.42.10(pid=21436): Terminating (SIGTERM) 16:16:34.302494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21437): Terminating (SIGTERM) 16:16:34.345468 run iperf3-srv_10.42.42.10(pid=21438): Terminating (SIGTERM) 16:16:34.387491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21441): Terminating (SIGTERM) 16:16:34.429679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21444): Terminating (SIGTERM) 16:16:34.472094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21447): Terminating (SIGTERM) 16:16:34.515171 --- ParallelTerminationStrategy: PID 21435 died... 16:16:34.535101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21435): Terminated: ok {rc=0} 16:16:34.582652 --- ParallelTerminationStrategy: PID 21436 died... 16:16:34.602554 run iperf3-srv_10.42.42.10(pid=21436): Terminated {rc=256} 16:16:34.649429 --- ParallelTerminationStrategy: PID 21437 died... 16:16:34.669167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21437): Terminated: ok {rc=0} 16:16:34.716654 --- ParallelTerminationStrategy: PID 21438 died... 16:16:34.736472 run iperf3-srv_10.42.42.10(pid=21438): Terminated {rc=256} 16:16:34.783894 --- ParallelTerminationStrategy: PID 21441 died... 16:16:34.803667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21441): Terminated: ok {rc=0} 16:16:34.850538 --- ParallelTerminationStrategy: PID 21444 died... 16:16:34.870439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21444): Terminated: ok {rc=0} 16:16:34.917391 --- ParallelTerminationStrategy: PID 21447 died... 16:16:34.937284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21447): Terminated: ok {rc=0} 16:16:35.026788 bus /gobi_0: Setting Powered False 16:16:36.127775 bus /gobi_0: Setting Powered False 16:16:37.245477 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx iperf3.py ---------------------------------------------- 16:16:38.391066 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:38.402805 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:16:38.454674 tst iperf3.py: using LAC 22225 16:16:38.578695 tst iperf3.py: using RAC 40 16:16:38.702103 tst iperf3.py: using CellId 22225 16:16:38.823719 tst iperf3.py: using BVCI 22226 16:16:38.947703 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:38.959027 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:38.970255 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:38.982143 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:38.994691 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:39.006050 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:39.018034 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:39.029921 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:39.041886 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:39.163049 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:16:39.374056 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:16:39.686504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21449): Launched 16:16:39.960938 run iperf3-srv_10.42.42.10(pid=21450): Launched 16:16:40.077780 tst iperf3.py:8: start network... 16:16:40.288550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:40.769785 run create_hlr_db(pid=21451): Launched 16:16:40.897905 bus /gobi_6: Setting Powered False 16:16:41.959879 run create_hlr_db(pid=21451): Terminated: ok {rc=0} 16:16:42.394836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21453): Launched 16:16:42.708221 run osmo-hlr_10.42.42.2(pid=21454): Launched 16:16:42.829887 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:43.371211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21456): Launched 16:16:43.682288 run osmo-stp_10.42.42.5(pid=21457): Launched 16:16:43.800474 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:16:44.339035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21459): Launched 16:16:44.459956 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:16:44.722547 run patchelf(pid=21460): Launched 16:16:44.895654 run osmo-stp_10.42.42.5(pid=21457): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21457)] 16:16:45.027766 run osmo-stp_10.42.42.5(pid=21457): stdout: | (launched: 2022-12-09_16:16:43.624826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:45.161743 run osmo-stp_10.42.42.5(pid=21457): stderr: | [0;m[38;5;43m20221209161643797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161643797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161643798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161643798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161643798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161643798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161643799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:45.295540 run osmo-stp_10.42.42.5(pid=21457): stdout: | (launched: 2022-12-09_16:16:43.624826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:45.422753 run osmo-stp_10.42.42.5(pid=21457): stderr: | [0;m[38;5;43m20221209161643797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161643797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161643798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161643798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161643798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161643798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161643799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:45.573694 run patchelf(pid=21460): Terminating (SIGINT) 16:16:45.747785 run patchelf(pid=21460): Terminated: ok {rc=0} 16:16:45.878369 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21457): Process ended prematurely: osmo-stp_10.42.42.5(pid=21457) [trial-2361↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21457)] [trial-2361↪gprs:trx-umtrx↪iperf3.py:8] 16:16:45.892135 tst iperf3.py:8: Test FAILED (7.5 sec) 16:16:45.924548 run osmo-hlr_10.42.42.2(pid=21454): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21454)] 16:16:45.978598 run osmo-hlr_10.42.42.2(pid=21454): stdout: | (launched: 2022-12-09_16:16:42.650670) 16:16:46.032931 run osmo-hlr_10.42.42.2(pid=21454): stderr: | [0;m[1;31m20221209161642830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161642830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161642830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161642830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161642830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161642830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161642841 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161642849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161642849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161642849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:46.084467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21449): Terminating (SIGTERM) 16:16:46.126158 run iperf3-srv_10.42.42.10(pid=21450): Terminating (SIGTERM) 16:16:46.170443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21453): Terminating (SIGTERM) 16:16:46.212914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21456): Terminating (SIGTERM) 16:16:46.253949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21459): Terminating (SIGTERM) 16:16:46.295466 --- ParallelTerminationStrategy: PID 21449 died... 16:16:46.315051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21449): Terminated: ok {rc=0} 16:16:46.360670 --- ParallelTerminationStrategy: PID 21450 died... 16:16:46.380183 run iperf3-srv_10.42.42.10(pid=21450): Terminated {rc=256} 16:16:46.425628 --- ParallelTerminationStrategy: PID 21453 died... 16:16:46.444940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21453): Terminated: ok {rc=0} 16:16:46.490646 --- ParallelTerminationStrategy: PID 21456 died... 16:16:46.510111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21456): Terminated: ok {rc=0} 16:16:46.555673 --- ParallelTerminationStrategy: PID 21459 died... 16:16:46.575227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21459): Terminated: ok {rc=0} 16:16:46.683689 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 16:16:47.852621 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:47.864645 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:16:47.917479 tst iperf3m4.py: using LAC 22226 16:16:48.039593 tst iperf3m4.py: using RAC 41 16:16:48.161474 tst iperf3m4.py: using CellId 22226 16:16:48.287089 tst iperf3m4.py: using BVCI 22227 16:16:48.400194 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:48.411127 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:48.421883 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:48.432559 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:48.443097 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:48.453754 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:48.464415 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:48.474813 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:16:48.486016 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:48.605371 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:48.733521 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:48.852213 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:16:48.975493 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:16:49.202666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:16:49.538242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21461): Launched 16:16:49.829319 run iperf3-srv_10.42.42.10(pid=21462): Launched 16:16:49.955387 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:16:50.181347 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:16:50.516192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21463): Launched 16:16:50.807910 run iperf3-srv_10.42.42.10(pid=21464): Launched 16:16:50.932655 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:16:51.159824 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:16:51.495859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21465): Launched 16:16:51.788399 run iperf3-srv_10.42.42.10(pid=21466): Launched 16:16:51.915222 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:16:52.141661 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:16:52.477417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21467): Launched 16:16:52.769601 run iperf3-srv_10.42.42.10(pid=21468): Launched 16:16:52.895459 tst iperf3m4.py:8: start network... 16:16:53.120258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:53.634496 run create_hlr_db(pid=21469): Launched 16:16:53.762267 bus /gobi_6: Setting Powered False 16:16:54.827025 run create_hlr_db(pid=21469): Terminated: ok {rc=0} 16:16:55.290311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21471): Launched 16:16:55.625077 run osmo-hlr_10.42.42.2(pid=21472): Launched 16:16:55.754392 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:56.329831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21474): Launched 16:16:56.667242 run osmo-stp_10.42.42.5(pid=21475): Launched 16:16:56.797154 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:16:57.374604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21477): Launched 16:16:57.506234 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:16:57.790155 run patchelf(pid=21478): Launched 16:16:57.977779 run osmo-stp_10.42.42.5(pid=21475): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21475)] 16:16:58.119389 run osmo-stp_10.42.42.5(pid=21475): stdout: | (launched: 2022-12-09_16:16:56.605874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:58.262517 run osmo-stp_10.42.42.5(pid=21475): stderr: | [0;m[38;5;43m20221209161656799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161656799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161656800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161656800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161656800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161656800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161656801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:58.406809 run osmo-stp_10.42.42.5(pid=21475): stdout: | (launched: 2022-12-09_16:16:56.605874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:58.543077 run osmo-stp_10.42.42.5(pid=21475): stderr: | [0;m[38;5;43m20221209161656799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161656799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161656800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161656800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161656800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161656800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161656801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:58.704824 run patchelf(pid=21478): Terminating (SIGINT) 16:16:58.890914 run patchelf(pid=21478): Terminated: ok {rc=0} 16:16:59.025222 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21475): Process ended prematurely: osmo-stp_10.42.42.5(pid=21475) [trial-2361↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21475)] [trial-2361↪gprs:trx-umtrx↪iperf3m4.py:8] 16:16:59.035443 tst iperf3m4.py:8: Test FAILED (11.2 sec) 16:16:59.065074 run osmo-hlr_10.42.42.2(pid=21472): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21472)] 16:16:59.115478 run osmo-hlr_10.42.42.2(pid=21472): stdout: | (launched: 2022-12-09_16:16:55.563775) 16:16:59.167651 run osmo-hlr_10.42.42.2(pid=21472): stderr: | [0;m[1;31m20221209161655763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161655763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161655763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161655763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161655763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161655763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161655775 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161655784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161655784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161655784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:59.220476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21461): Terminating (SIGTERM) 16:16:59.262906 run iperf3-srv_10.42.42.10(pid=21462): Terminating (SIGTERM) 16:16:59.305439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21463): Terminating (SIGTERM) 16:16:59.348024 run iperf3-srv_10.42.42.10(pid=21464): Terminating (SIGTERM) 16:16:59.390778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21465): Terminating (SIGTERM) 16:16:59.433526 run iperf3-srv_10.42.42.10(pid=21466): Terminating (SIGTERM) 16:16:59.475590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21467): Terminating (SIGTERM) 16:16:59.517760 run iperf3-srv_10.42.42.10(pid=21468): Terminating (SIGTERM) 16:16:59.560016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21471): Terminating (SIGTERM) 16:16:59.602417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21474): Terminating (SIGTERM) 16:16:59.644549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21477): Terminating (SIGTERM) 16:16:59.687147 --- ParallelTerminationStrategy: PID 21461 died... 16:16:59.707324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21461): Terminated: ok {rc=0} 16:16:59.754385 --- ParallelTerminationStrategy: PID 21462 died... 16:16:59.774072 run iperf3-srv_10.42.42.10(pid=21462): Terminated {rc=256} 16:16:59.820918 --- ParallelTerminationStrategy: PID 21463 died... 16:16:59.840647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21463): Terminated: ok {rc=0} 16:16:59.887640 --- ParallelTerminationStrategy: PID 21464 died... 16:16:59.907341 run iperf3-srv_10.42.42.10(pid=21464): Terminated {rc=256} 16:16:59.953992 --- ParallelTerminationStrategy: PID 21465 died... 16:16:59.973789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21465): Terminated: ok {rc=0} 16:17:00.020742 --- ParallelTerminationStrategy: PID 21466 died... 16:17:00.040536 run iperf3-srv_10.42.42.10(pid=21466): Terminated {rc=256} 16:17:00.087229 --- ParallelTerminationStrategy: PID 21467 died... 16:17:00.107071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21467): Terminated: ok {rc=0} 16:17:00.153856 --- ParallelTerminationStrategy: PID 21468 died... 16:17:00.173526 run iperf3-srv_10.42.42.10(pid=21468): Terminated {rc=256} 16:17:00.220411 --- ParallelTerminationStrategy: PID 21471 died... 16:17:00.240107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21471): Terminated: ok {rc=0} 16:17:00.286874 --- ParallelTerminationStrategy: PID 21474 died... 16:17:00.306696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21474): Terminated: ok {rc=0} 16:17:00.355131 --- ParallelTerminationStrategy: PID 21477 died... 16:17:00.374077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21477): Terminated: ok {rc=0} 16:17:00.462116 bus /gobi_4: Setting Powered False 16:17:01.567747 bus /gobi_4: Setting Powered False 16:17:02.685015 bus /gobi_1: Setting Powered False 16:17:03.783579 bus /gobi_1: Setting Powered False 16:17:04.899473 bus /gobi_0: Setting Powered False 16:17:05.997378 bus /gobi_0: Setting Powered False 16:17:07.114999 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx ping.py ---------------------------------------------- 16:17:08.218957 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:08.230778 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:17:08.281289 tst ping.py: using LAC 22227 16:17:08.409627 tst ping.py: using RAC 42 16:17:08.537601 tst ping.py: using CellId 22227 16:17:08.666751 tst ping.py: using BVCI 22228 16:17:08.784697 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:08.795929 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:08.806983 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:08.818244 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:08.829386 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:08.840459 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:08.851817 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:08.863084 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:17:08.984889 tst ping.py:19: start network... 16:17:09.207181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:09.714434 run create_hlr_db(pid=21482): Launched 16:17:09.838236 bus /gobi_6: Setting Powered False 16:17:10.902308 run create_hlr_db(pid=21482): Terminated: ok {rc=0} 16:17:11.356493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21484): Launched 16:17:11.683377 run osmo-hlr_10.42.42.2(pid=21485): Launched 16:17:11.809649 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:12.376008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21487): Launched 16:17:12.703821 run osmo-stp_10.42.42.5(pid=21488): Launched 16:17:12.830396 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:17:13.394218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21490): Launched 16:17:13.519527 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:17:13.796169 run patchelf(pid=21491): Launched 16:17:13.979784 run osmo-stp_10.42.42.5(pid=21488): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21488)] 16:17:14.118912 run osmo-stp_10.42.42.5(pid=21488): stdout: | (launched: 2022-12-09_16:17:12.643926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:14.260034 run osmo-stp_10.42.42.5(pid=21488): stderr: | [0;m[38;5;43m20221209161712839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161712840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161712840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161712840 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161712841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161712841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161712841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:14.400774 run osmo-stp_10.42.42.5(pid=21488): stdout: | (launched: 2022-12-09_16:17:12.643926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:14.535429 run osmo-stp_10.42.42.5(pid=21488): stderr: | [0;m[38;5;43m20221209161712839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161712840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161712840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161712840 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161712841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161712841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161712841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:14.694607 run patchelf(pid=21491): Terminating (SIGINT) 16:17:14.876675 run patchelf(pid=21491): Terminated: ok {rc=0} 16:17:15.008503 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21488): Process ended prematurely: osmo-stp_10.42.42.5(pid=21488) [trial-2361↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21488)] [trial-2361↪gprs:trx-umtrx↪ping.py:22] 16:17:15.018408 tst ping.py:22: Test FAILED (6.8 sec) 16:17:15.047449 run osmo-hlr_10.42.42.2(pid=21485): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21485)] 16:17:15.097893 run osmo-hlr_10.42.42.2(pid=21485): stdout: | (launched: 2022-12-09_16:17:11.623473) 16:17:15.150176 run osmo-hlr_10.42.42.2(pid=21485): stderr: | [0;m[1;31m20221209161711823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161711823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161711823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161711823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161711823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161711823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161711836 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161711844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161711844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161711844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:15.202643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21484): Terminating (SIGTERM) 16:17:15.244543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21487): Terminating (SIGTERM) 16:17:15.286707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21490): Terminating (SIGTERM) 16:17:15.329036 --- ParallelTerminationStrategy: PID 21484 died... 16:17:15.349179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21484): Terminated: ok {rc=0} 16:17:15.396725 --- ParallelTerminationStrategy: PID 21487 died... 16:17:15.416737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21487): Terminated: ok {rc=0} 16:17:15.463427 --- ParallelTerminationStrategy: PID 21490 died... 16:17:15.483226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21490): Terminated: ok {rc=0} 16:17:15.571567 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 16:17:16.662834 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:16.680414 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:17:16.745631 tst ping_idle_ping.py: using LAC 22228 16:17:16.872619 tst ping_idle_ping.py: using RAC 43 16:17:17.031919 tst ping_idle_ping.py: using CellId 22228 16:17:17.155761 tst ping_idle_ping.py: using BVCI 22229 16:17:17.277481 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:17.289399 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:17.301351 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:17.314457 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:17.326995 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:17.338835 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:17.351926 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:17:17.363920 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:17:17.485312 tst ping_idle_ping.py:24: start network... 16:17:17.692521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:18.167803 run create_hlr_db(pid=21492): Launched 16:17:18.293133 bus /gobi_6: Setting Powered False 16:17:19.354534 run create_hlr_db(pid=21492): Terminated: ok {rc=0} 16:17:19.781585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21494): Launched 16:17:20.088082 run osmo-hlr_10.42.42.2(pid=21495): Launched 16:17:20.204647 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:20.730577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21497): Launched 16:17:21.037538 run osmo-stp_10.42.42.5(pid=21498): Launched 16:17:21.153899 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:17:21.680439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21500): Launched 16:17:21.797741 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:17:22.056647 run patchelf(pid=21501): Launched 16:17:22.226932 run osmo-stp_10.42.42.5(pid=21498): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21498)] 16:17:22.356024 run osmo-stp_10.42.42.5(pid=21498): stdout: | (launched: 2022-12-09_16:17:20.980681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:22.487593 run osmo-stp_10.42.42.5(pid=21498): stderr: | [0;m[38;5;43m20221209161721152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161721153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161721153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161721153 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161721155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161721156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161721156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:22.619320 run osmo-stp_10.42.42.5(pid=21498): stdout: | (launched: 2022-12-09_16:17:20.980681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:22.744211 run osmo-stp_10.42.42.5(pid=21498): stderr: | [0;m[38;5;43m20221209161721152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161721153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161721153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161721153 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161721155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161721156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161721156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:22.892600 run patchelf(pid=21501): Terminating (SIGINT) 16:17:23.063067 run patchelf(pid=21501): Terminated: ok {rc=0} 16:17:23.185919 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21498): Process ended prematurely: osmo-stp_10.42.42.5(pid=21498) [trial-2361↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21498)] [trial-2361↪gprs:trx-umtrx↪ping_idle_ping.py:27] 16:17:23.194769 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:17:23.221558 run osmo-hlr_10.42.42.2(pid=21495): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21495)] 16:17:23.269726 run osmo-hlr_10.42.42.2(pid=21495): stdout: | (launched: 2022-12-09_16:17:20.031393) 16:17:23.319539 run osmo-hlr_10.42.42.2(pid=21495): stderr: | [0;m[1;31m20221209161720213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161720213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161720213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161720213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161720213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161720213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161720226 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161720236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161720237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161720237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:23.369622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21494): Terminating (SIGTERM) 16:17:23.409849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21497): Terminating (SIGTERM) 16:17:23.449854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21500): Terminating (SIGTERM) 16:17:23.490362 --- ParallelTerminationStrategy: PID 21494 died... 16:17:23.509705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21494): Terminated: ok {rc=0} 16:17:23.554177 --- ParallelTerminationStrategy: PID 21497 died... 16:17:23.572818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21497): Terminated: ok {rc=0} 16:17:23.617119 --- ParallelTerminationStrategy: PID 21500 died... 16:17:23.635926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21500): Terminated: ok {rc=0} 16:17:23.720732 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 16:17:25.022735 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:17:25.028649 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:17:25.063024 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:17:25.103253 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:17:25.193874 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:17:25.228231 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:17:25.268280 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:17:25.860688 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:17:25.915291 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:25.926896 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:17:25.978018 tst cs_paging_gprs_active.py: using LAC 22229 16:17:26.108476 tst cs_paging_gprs_active.py: using RAC 44 16:17:26.232714 tst cs_paging_gprs_active.py: using CellId 22229 16:17:26.355659 tst cs_paging_gprs_active.py: using BVCI 22230 16:17:26.478860 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:26.490572 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:26.502042 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:26.513893 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:26.525456 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:26.536811 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:26.549619 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:26.560928 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:26.572754 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:17:26.696319 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:17:26.815826 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:17:27.028321 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:17:27.343086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21505): Launched 16:17:27.618733 run iperf3-srv_10.42.42.10(pid=21506): Launched 16:17:27.738346 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:17:27.948553 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:17:28.263307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21507): Launched 16:17:28.537612 run iperf3-srv_10.42.42.10(pid=21508): Launched 16:17:28.654971 tst cs_paging_gprs_active.py:38: start network... 16:17:28.863784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:29.346893 run create_hlr_db(pid=21509): Launched 16:17:29.477159 bus /gobi_6: Setting Powered False 16:17:30.538281 run create_hlr_db(pid=21509): Terminated: ok {rc=0} 16:17:31.010258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21511): Launched 16:17:31.388795 run osmo-hlr_10.42.42.2(pid=21512): Launched 16:17:31.646575 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:32.402378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21514): Launched 16:17:32.716508 run osmo-stp_10.42.42.5(pid=21515): Launched 16:17:32.834769 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:17:33.370879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21517): Launched 16:17:33.492196 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:17:33.756050 run patchelf(pid=21518): Launched 16:17:33.929257 run osmo-stp_10.42.42.5(pid=21515): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21515)] 16:17:34.063230 run osmo-stp_10.42.42.5(pid=21515): stdout: | (launched: 2022-12-09_16:17:32.658989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:34.196577 run osmo-stp_10.42.42.5(pid=21515): stderr: | [0;m[38;5;43m20221209161732832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161732833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161732833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161732833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161732834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161732834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161732834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:34.330105 run osmo-stp_10.42.42.5(pid=21515): stdout: | (launched: 2022-12-09_16:17:32.658989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:34.457402 run osmo-stp_10.42.42.5(pid=21515): stderr: | [0;m[38;5;43m20221209161732832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161732833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161732833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161732833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161732834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161732834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161732834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:34.608761 run patchelf(pid=21518): Terminating (SIGINT) 16:17:34.784000 run patchelf(pid=21518): Terminated: ok {rc=0} 16:17:34.909972 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21515): Process ended prematurely: osmo-stp_10.42.42.5(pid=21515) [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21515)] [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:17:34.919365 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:17:34.946840 run osmo-hlr_10.42.42.2(pid=21512): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21512)] 16:17:34.994976 run osmo-hlr_10.42.42.2(pid=21512): stdout: | (launched: 2022-12-09_16:17:31.329145) 16:17:35.045261 run osmo-hlr_10.42.42.2(pid=21512): stderr: | [0;m[1;31m20221209161731634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161731634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161731634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161731634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161731634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161731634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161731647 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161731659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161731660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161731660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:35.095178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21505): Terminating (SIGTERM) 16:17:35.135185 run iperf3-srv_10.42.42.10(pid=21506): Terminating (SIGTERM) 16:17:35.175143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21507): Terminating (SIGTERM) 16:17:35.215133 run iperf3-srv_10.42.42.10(pid=21508): Terminating (SIGTERM) 16:17:35.255090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21511): Terminating (SIGTERM) 16:17:35.295194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21514): Terminating (SIGTERM) 16:17:35.335148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21517): Terminating (SIGTERM) 16:17:35.375402 --- ParallelTerminationStrategy: PID 21505 died... 16:17:35.394655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21505): Terminated: ok {rc=0} 16:17:35.438691 --- ParallelTerminationStrategy: PID 21506 died... 16:17:35.457289 run iperf3-srv_10.42.42.10(pid=21506): Terminated {rc=256} 16:17:35.501281 --- ParallelTerminationStrategy: PID 21507 died... 16:17:35.519757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21507): Terminated: ok {rc=0} 16:17:35.563826 --- ParallelTerminationStrategy: PID 21508 died... 16:17:35.582490 run iperf3-srv_10.42.42.10(pid=21508): Terminated {rc=256} 16:17:35.626320 --- ParallelTerminationStrategy: PID 21511 died... 16:17:35.645077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21511): Terminated: ok {rc=0} 16:17:35.689117 --- ParallelTerminationStrategy: PID 21514 died... 16:17:35.707796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21514): Terminated: ok {rc=0} 16:17:35.751616 --- ParallelTerminationStrategy: PID 21517 died... 16:17:35.770288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21517): Terminated: ok {rc=0} 16:17:35.859316 bus /gobi_0: Setting Powered False 16:17:36.958966 bus /gobi_0: Setting Powered False 16:17:38.075394 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:17:39.227741 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.240018 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:17:39.294748 tst iperf3.py: using LAC 22230 16:17:39.426635 tst iperf3.py: using RAC 45 16:17:39.558172 tst iperf3.py: using CellId 22230 16:17:39.682110 tst iperf3.py: using BVCI 22231 16:17:39.794764 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.805846 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.816632 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.827568 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.838264 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.848885 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.859821 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.870479 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:39.881396 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:17:40.002378 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:17:40.212684 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:17:40.527095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21522): Launched 16:17:40.801475 run iperf3-srv_10.42.42.10(pid=21523): Launched 16:17:40.917546 tst iperf3.py:8: start network... 16:17:41.125766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:41.604330 run create_hlr_db(pid=21524): Launched 16:17:41.730270 bus /gobi_6: Setting Powered False 16:17:42.792060 run create_hlr_db(pid=21524): Terminated: ok {rc=0} 16:17:43.244811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21526): Launched 16:17:43.581817 run osmo-hlr_10.42.42.2(pid=21527): Launched 16:17:43.708415 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:44.289973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21529): Launched 16:17:44.624571 run osmo-stp_10.42.42.5(pid=21530): Launched 16:17:44.753249 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:17:45.327098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21532): Launched 16:17:45.455799 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:17:45.736517 run patchelf(pid=21533): Launched 16:17:45.937951 run osmo-stp_10.42.42.5(pid=21530): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21530)] 16:17:46.075114 run osmo-stp_10.42.42.5(pid=21530): stdout: | (launched: 2022-12-09_16:17:44.563585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:46.214254 run osmo-stp_10.42.42.5(pid=21530): stderr: | [0;m[38;5;43m20221209161744758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161744758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161744758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161744759 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161744761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161744761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161744761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:46.352488 run osmo-stp_10.42.42.5(pid=21530): stdout: | (launched: 2022-12-09_16:17:44.563585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:46.483123 run osmo-stp_10.42.42.5(pid=21530): stderr: | [0;m[38;5;43m20221209161744758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161744758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161744758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161744759 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161744761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161744761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161744761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:46.640619 run patchelf(pid=21533): Terminating (SIGINT) 16:17:46.822111 run patchelf(pid=21533): Terminated: ok {rc=0} 16:17:46.953607 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21530): Process ended prematurely: osmo-stp_10.42.42.5(pid=21530) [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21530)] [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 16:17:46.963882 tst iperf3.py:8: Test FAILED (7.8 sec) 16:17:46.992356 run osmo-hlr_10.42.42.2(pid=21527): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21527)] 16:17:47.042262 run osmo-hlr_10.42.42.2(pid=21527): stdout: | (launched: 2022-12-09_16:17:43.518896) 16:17:47.093771 run osmo-hlr_10.42.42.2(pid=21527): stderr: | [0;m[1;31m20221209161743719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161743719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161743719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161743719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161743719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161743719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161743732 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161743742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161743742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161743742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:47.145527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21522): Terminating (SIGTERM) 16:17:47.187309 run iperf3-srv_10.42.42.10(pid=21523): Terminating (SIGTERM) 16:17:47.227332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21526): Terminating (SIGTERM) 16:17:47.267483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21529): Terminating (SIGTERM) 16:17:47.307399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21532): Terminating (SIGTERM) 16:17:47.348783 --- ParallelTerminationStrategy: PID 21522 died... 16:17:47.368050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21522): Terminated: ok {rc=0} 16:17:47.413080 --- ParallelTerminationStrategy: PID 21523 died... 16:17:47.431919 run iperf3-srv_10.42.42.10(pid=21523): Terminated {rc=256} 16:17:47.476228 --- ParallelTerminationStrategy: PID 21526 died... 16:17:47.495080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21526): Terminated: ok {rc=0} 16:17:47.539344 --- ParallelTerminationStrategy: PID 21529 died... 16:17:47.558202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21529): Terminated: ok {rc=0} 16:17:47.602618 --- ParallelTerminationStrategy: PID 21532 died... 16:17:47.621483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21532): Terminated: ok {rc=0} 16:17:47.708342 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:17:48.858540 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:48.870224 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:17:48.920772 tst iperf3m4.py: using LAC 22231 16:17:49.044548 tst iperf3m4.py: using RAC 46 16:17:49.167573 tst iperf3m4.py: using CellId 22231 16:17:49.291480 tst iperf3m4.py: using BVCI 22232 16:17:49.406291 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:49.417394 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:49.428148 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:49.438894 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:49.449756 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:49.460349 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:49.471198 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:49.481850 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:17:49.492633 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:17:49.616148 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:17:49.738993 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:17:49.862183 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:17:49.985305 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:17:50.212148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:17:50.549404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21534): Launched 16:17:50.841212 run iperf3-srv_10.42.42.10(pid=21535): Launched 16:17:50.968054 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:17:51.195291 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:17:51.532660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21536): Launched 16:17:51.826118 run iperf3-srv_10.42.42.10(pid=21537): Launched 16:17:51.951915 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:17:52.178199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:17:52.514914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21538): Launched 16:17:52.806647 run iperf3-srv_10.42.42.10(pid=21539): Launched 16:17:52.933948 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:17:53.159759 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:17:53.496348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21540): Launched 16:17:53.789515 run iperf3-srv_10.42.42.10(pid=21541): Launched 16:17:53.915508 tst iperf3m4.py:8: start network... 16:17:54.141033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:54.656282 run create_hlr_db(pid=21542): Launched 16:17:54.786131 bus /gobi_6: Setting Powered False 16:17:55.851833 run create_hlr_db(pid=21542): Terminated: ok {rc=0} 16:17:56.314923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21544): Launched 16:17:56.649743 run osmo-hlr_10.42.42.2(pid=21545): Launched 16:17:56.778557 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:57.356341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21547): Launched 16:17:57.694066 run osmo-stp_10.42.42.5(pid=21548): Launched 16:17:57.823648 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:17:58.399931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21550): Launched 16:17:58.530918 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:17:58.813324 run patchelf(pid=21551): Launched 16:17:59.000663 run osmo-stp_10.42.42.5(pid=21548): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21548)] 16:17:59.142248 run osmo-stp_10.42.42.5(pid=21548): stdout: | (launched: 2022-12-09_16:17:57.632369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:59.285289 run osmo-stp_10.42.42.5(pid=21548): stderr: | [0;m[38;5;43m20221209161757829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161757829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161757830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161757830 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161757830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161757830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161757831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:59.428788 run osmo-stp_10.42.42.5(pid=21548): stdout: | (launched: 2022-12-09_16:17:57.632369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:59.565459 run osmo-stp_10.42.42.5(pid=21548): stderr: | [0;m[38;5;43m20221209161757829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161757829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161757830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161757830 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161757830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161757830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161757831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:59.727088 run patchelf(pid=21551): Terminating (SIGINT) 16:17:59.913666 run patchelf(pid=21551): Terminated: ok {rc=0} 16:18:00.049018 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21548): Process ended prematurely: osmo-stp_10.42.42.5(pid=21548) [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21548)] [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 16:18:00.059331 tst iperf3m4.py:8: Test FAILED (11.2 sec) 16:18:00.089146 run osmo-hlr_10.42.42.2(pid=21545): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21545)] 16:18:00.140091 run osmo-hlr_10.42.42.2(pid=21545): stdout: | (launched: 2022-12-09_16:17:56.588367) 16:18:00.192774 run osmo-hlr_10.42.42.2(pid=21545): stderr: | [0;m[1;31m20221209161756791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161756791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161756791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161756791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161756791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161756791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161756804 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161756812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161756813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161756813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:00.245935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21534): Terminating (SIGTERM) 16:18:00.288175 run iperf3-srv_10.42.42.10(pid=21535): Terminating (SIGTERM) 16:18:00.330619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21536): Terminating (SIGTERM) 16:18:00.372818 run iperf3-srv_10.42.42.10(pid=21537): Terminating (SIGTERM) 16:18:00.415349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21538): Terminating (SIGTERM) 16:18:00.457815 run iperf3-srv_10.42.42.10(pid=21539): Terminating (SIGTERM) 16:18:00.499942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21540): Terminating (SIGTERM) 16:18:00.542250 run iperf3-srv_10.42.42.10(pid=21541): Terminating (SIGTERM) 16:18:00.584378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21544): Terminating (SIGTERM) 16:18:00.626918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21547): Terminating (SIGTERM) 16:18:00.669193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21550): Terminating (SIGTERM) 16:18:00.711771 --- ParallelTerminationStrategy: PID 21534 died... 16:18:00.731818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21534): Terminated: ok {rc=0} 16:18:00.779400 --- ParallelTerminationStrategy: PID 21535 died... 16:18:00.799276 run iperf3-srv_10.42.42.10(pid=21535): Terminated {rc=256} 16:18:00.866664 --- ParallelTerminationStrategy: PID 21536 died... 16:18:00.897821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21536): Terminated: ok {rc=0} 16:18:00.946738 --- ParallelTerminationStrategy: PID 21537 died... 16:18:00.967054 run iperf3-srv_10.42.42.10(pid=21537): Terminated {rc=256} 16:18:01.014380 --- ParallelTerminationStrategy: PID 21538 died... 16:18:01.034713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21538): Terminated: ok {rc=0} 16:18:01.082453 --- ParallelTerminationStrategy: PID 21539 died... 16:18:01.102812 run iperf3-srv_10.42.42.10(pid=21539): Terminated {rc=256} 16:18:01.150627 --- ParallelTerminationStrategy: PID 21540 died... 16:18:01.171048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21540): Terminated: ok {rc=0} 16:18:01.219261 --- ParallelTerminationStrategy: PID 21541 died... 16:18:01.239656 run iperf3-srv_10.42.42.10(pid=21541): Terminated {rc=256} 16:18:01.287596 --- ParallelTerminationStrategy: PID 21544 died... 16:18:01.307831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21544): Terminated: ok {rc=0} 16:18:01.363659 --- ParallelTerminationStrategy: PID 21547 died... 16:18:01.388591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21547): Terminated: ok {rc=0} 16:18:01.444904 --- ParallelTerminationStrategy: PID 21550 died... 16:18:01.469984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21550): Terminated: ok {rc=0} 16:18:01.582576 bus /gobi_4: Setting Powered False 16:18:02.691045 bus /gobi_4: Setting Powered False 16:18:03.808283 bus /gobi_1: Setting Powered False 16:18:04.907938 bus /gobi_1: Setting Powered False 16:18:06.023355 bus /gobi_0: Setting Powered False 16:18:07.122675 bus /gobi_0: Setting Powered False 16:18:08.239307 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 16:18:09.344595 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:09.356381 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:18:09.409769 tst ping.py: using LAC 22232 16:18:09.527821 tst ping.py: using RAC 47 16:18:09.645510 tst ping.py: using CellId 22232 16:18:09.777462 tst ping.py: using BVCI 22233 16:18:09.891794 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:09.902843 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:09.913742 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:09.924520 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:09.935220 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:09.945942 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:09.956938 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:09.967716 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:18:10.087928 tst ping.py:19: start network... 16:18:10.310048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:10.817453 run create_hlr_db(pid=21552): Launched 16:18:10.942146 bus /gobi_6: Setting Powered False 16:18:12.006815 run create_hlr_db(pid=21552): Terminated: ok {rc=0} 16:18:12.446620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21554): Launched 16:18:12.755989 run osmo-hlr_10.42.42.2(pid=21555): Launched 16:18:12.873321 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:13.419733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21557): Launched 16:18:13.725679 run osmo-stp_10.42.42.5(pid=21558): Launched 16:18:13.841958 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:18:14.366093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21560): Launched 16:18:14.482500 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:18:14.740542 run patchelf(pid=21561): Launched 16:18:14.910614 run osmo-stp_10.42.42.5(pid=21558): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21558)] 16:18:15.039885 run osmo-stp_10.42.42.5(pid=21558): stdout: | (launched: 2022-12-09_16:18:13.668789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:15.170692 run osmo-stp_10.42.42.5(pid=21558): stderr: | [0;m[38;5;43m20221209161813842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161813842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161813843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161813843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161813843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161813843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161813843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:15.300933 run osmo-stp_10.42.42.5(pid=21558): stdout: | (launched: 2022-12-09_16:18:13.668789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:15.425547 run osmo-stp_10.42.42.5(pid=21558): stderr: | [0;m[38;5;43m20221209161813842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161813842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161813843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161813843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161813843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161813843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161813843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:15.572915 run patchelf(pid=21561): Terminating (SIGINT) 16:18:15.742834 run patchelf(pid=21561): Terminated: ok {rc=0} 16:18:15.873610 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21558): Process ended prematurely: osmo-stp_10.42.42.5(pid=21558) [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21558)] [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 16:18:15.885503 tst ping.py:22: Test FAILED (6.5 sec) 16:18:15.925713 run osmo-hlr_10.42.42.2(pid=21555): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21555)] 16:18:15.983368 run osmo-hlr_10.42.42.2(pid=21555): stdout: | (launched: 2022-12-09_16:18:12.699231) 16:18:16.042400 run osmo-hlr_10.42.42.2(pid=21555): stderr: | [0;m[1;31m20221209161812876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161812876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161812876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161812876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161812876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161812876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161812889 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161812898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161812898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161812898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:16.100830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21554): Terminating (SIGTERM) 16:18:16.151183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21557): Terminating (SIGTERM) 16:18:16.208928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21560): Terminating (SIGTERM) 16:18:16.250417 --- ParallelTerminationStrategy: PID 21554 died... 16:18:16.269813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21554): Terminated: ok {rc=0} 16:18:16.315771 --- ParallelTerminationStrategy: PID 21557 died... 16:18:16.336782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21557): Terminated: ok {rc=0} 16:18:16.387717 --- ParallelTerminationStrategy: PID 21560 died... 16:18:16.409046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21560): Terminated: ok {rc=0} 16:18:16.502500 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:18:17.593614 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:17.605423 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:18:17.656427 tst ping_idle_ping.py: using LAC 22233 16:18:17.777419 tst ping_idle_ping.py: using RAC 48 16:18:17.896436 tst ping_idle_ping.py: using CellId 22233 16:18:18.021228 tst ping_idle_ping.py: using BVCI 22234 16:18:18.133213 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:18.144060 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:18.154892 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:18.165648 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:18.176269 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:18.186960 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:18.197874 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:18:18.208584 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:18:18.329545 tst ping_idle_ping.py:24: start network... 16:18:18.553150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:19.064264 run create_hlr_db(pid=21562): Launched 16:18:19.192274 bus /gobi_6: Setting Powered False 16:18:20.253936 run create_hlr_db(pid=21562): Terminated: ok {rc=0} 16:18:20.716529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21564): Launched 16:18:21.049500 run osmo-hlr_10.42.42.2(pid=21565): Launched 16:18:21.176898 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:21.743680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21567): Launched 16:18:22.074737 run osmo-stp_10.42.42.5(pid=21568): Launched 16:18:22.202487 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:18:22.771851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21570): Launched 16:18:22.900094 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:18:23.178882 run patchelf(pid=21571): Launched 16:18:23.363628 run osmo-stp_10.42.42.5(pid=21568): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21568)] 16:18:23.503409 run osmo-stp_10.42.42.5(pid=21568): stdout: | (launched: 2022-12-09_16:18:22.014229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:23.644561 run osmo-stp_10.42.42.5(pid=21568): stderr: | [0;m[38;5;43m20221209161822209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161822210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161822210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161822210 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161822211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161822211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161822211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:23.785174 run osmo-stp_10.42.42.5(pid=21568): stdout: | (launched: 2022-12-09_16:18:22.014229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:23.919875 run osmo-stp_10.42.42.5(pid=21568): stderr: | [0;m[38;5;43m20221209161822209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161822210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161822210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161822210 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161822211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161822211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161822211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:24.080002 run patchelf(pid=21571): Terminating (SIGINT) 16:18:24.263250 run patchelf(pid=21571): Terminated: ok {rc=0} 16:18:24.395711 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21568): Process ended prematurely: osmo-stp_10.42.42.5(pid=21568) [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21568)] [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 16:18:24.405842 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 16:18:24.434510 run osmo-hlr_10.42.42.2(pid=21565): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21565)] 16:18:24.485308 run osmo-hlr_10.42.42.2(pid=21565): stdout: | (launched: 2022-12-09_16:18:20.988807) 16:18:24.537734 run osmo-hlr_10.42.42.2(pid=21565): stderr: | [0;m[1;31m20221209161821189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161821189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161821189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161821189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161821189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161821189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161821202 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161821210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161821210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161821210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:24.590725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21564): Terminating (SIGTERM) 16:18:24.633190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21567): Terminating (SIGTERM) 16:18:24.675614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21570): Terminating (SIGTERM) 16:18:24.718386 --- ParallelTerminationStrategy: PID 21564 died... 16:18:24.738576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21564): Terminated: ok {rc=0} 16:18:24.785526 --- ParallelTerminationStrategy: PID 21567 died... 16:18:24.805167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21567): Terminated: ok {rc=0} 16:18:24.851868 --- ParallelTerminationStrategy: PID 21570 died... 16:18:24.871576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21570): Terminated: ok {rc=0} 16:18:24.961008 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:18:26.280132 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:18:26.287291 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:18:26.319810 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:18:26.358405 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:18:26.453390 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:18:26.486314 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:18:26.524602 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:18:27.113881 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:18:27.163933 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:27.174987 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:18:27.244448 tst cs_paging_gprs_active.py: using LAC 22234 16:18:27.367612 tst cs_paging_gprs_active.py: using RAC 49 16:18:27.490668 tst cs_paging_gprs_active.py: using CellId 22234 16:18:27.622801 tst cs_paging_gprs_active.py: using BVCI 22235 16:18:27.745992 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:27.757653 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:27.769204 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:27.780752 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:27.792412 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:27.803879 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:27.815481 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:27.827009 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:27.838656 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:18:27.957235 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:18:28.079245 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:18:28.306338 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:28.643416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21575): Launched 16:18:28.936350 run iperf3-srv_10.42.42.10(pid=21576): Launched 16:18:29.064034 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:18:29.290243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:29.628139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21577): Launched 16:18:29.922096 run iperf3-srv_10.42.42.10(pid=21578): Launched 16:18:30.049856 tst cs_paging_gprs_active.py:38: start network... 16:18:30.276278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:30.794843 run create_hlr_db(pid=21579): Launched 16:18:30.937088 bus /gobi_6: Setting Powered False 16:18:32.018474 run create_hlr_db(pid=21579): Terminated: ok {rc=0} 16:18:32.498156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21581): Launched 16:18:32.813161 run osmo-hlr_10.42.42.2(pid=21582): Launched 16:18:32.931905 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:33.470567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21584): Launched 16:18:33.786438 run osmo-stp_10.42.42.5(pid=21585): Launched 16:18:33.906788 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:18:34.442943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21587): Launched 16:18:34.564574 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:18:34.836742 run patchelf(pid=21588): Launched 16:18:35.012595 run osmo-stp_10.42.42.5(pid=21585): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21585)] 16:18:35.145756 run osmo-stp_10.42.42.5(pid=21585): stdout: | (launched: 2022-12-09_16:18:33.728335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:35.279578 run osmo-stp_10.42.42.5(pid=21585): stderr: | [0;m[38;5;43m20221209161833900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161833901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161833901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161833901 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161833903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161833904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161833904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:35.413531 run osmo-stp_10.42.42.5(pid=21585): stdout: | (launched: 2022-12-09_16:18:33.728335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:35.540779 run osmo-stp_10.42.42.5(pid=21585): stderr: | [0;m[38;5;43m20221209161833900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161833901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161833901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161833901 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161833903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161833904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161833904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:35.691711 run patchelf(pid=21588): Terminating (SIGINT) 16:18:35.867247 run patchelf(pid=21588): Terminated: ok {rc=0} 16:18:35.993597 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21585): Process ended prematurely: osmo-stp_10.42.42.5(pid=21585) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21585)] [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:18:36.003047 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 16:18:36.030418 run osmo-hlr_10.42.42.2(pid=21582): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21582)] 16:18:36.078216 run osmo-hlr_10.42.42.2(pid=21582): stdout: | (launched: 2022-12-09_16:18:32.755636) 16:18:36.127404 run osmo-hlr_10.42.42.2(pid=21582): stderr: | [0;m[1;31m20221209161832936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161832936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161832936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161832936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161832936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161832936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161832949 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161832960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161832960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161832960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:36.177254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21575): Terminating (SIGTERM) 16:18:36.216798 run iperf3-srv_10.42.42.10(pid=21576): Terminating (SIGTERM) 16:18:36.256313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21577): Terminating (SIGTERM) 16:18:36.295886 run iperf3-srv_10.42.42.10(pid=21578): Terminating (SIGTERM) 16:18:36.335402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21581): Terminating (SIGTERM) 16:18:36.375197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21584): Terminating (SIGTERM) 16:18:36.415048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21587): Terminating (SIGTERM) 16:18:36.455402 --- ParallelTerminationStrategy: PID 21575 died... 16:18:36.474652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21575): Terminated: ok {rc=0} 16:18:36.518914 --- ParallelTerminationStrategy: PID 21576 died... 16:18:36.537660 run iperf3-srv_10.42.42.10(pid=21576): Terminated {rc=256} 16:18:36.582281 --- ParallelTerminationStrategy: PID 21577 died... 16:18:36.601091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21577): Terminated: ok {rc=0} 16:18:36.645203 --- ParallelTerminationStrategy: PID 21578 died... 16:18:36.663841 run iperf3-srv_10.42.42.10(pid=21578): Terminated {rc=256} 16:18:36.707953 --- ParallelTerminationStrategy: PID 21581 died... 16:18:36.726742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21581): Terminated: ok {rc=0} 16:18:36.770884 --- ParallelTerminationStrategy: PID 21584 died... 16:18:36.789795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21584): Terminated: ok {rc=0} 16:18:36.834119 --- ParallelTerminationStrategy: PID 21587 died... 16:18:36.852929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21587): Terminated: ok {rc=0} 16:18:36.936733 bus /gobi_0: Setting Powered False 16:18:38.033770 bus /gobi_0: Setting Powered False 16:18:39.148253 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:18:40.297088 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:40.308733 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:18:40.378817 tst iperf3.py: using LAC 22235 16:18:40.502642 tst iperf3.py: using RAC 50 16:18:40.625145 tst iperf3.py: using CellId 22235 16:18:40.746041 tst iperf3.py: using BVCI 22236 16:18:40.858629 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:40.869725 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:40.880602 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:40.891505 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:40.902264 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:40.913063 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:40.923987 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:40.934742 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:40.945734 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:18:41.062171 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:18:41.272691 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:41.586342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21589): Launched 16:18:41.859771 run iperf3-srv_10.42.42.10(pid=21590): Launched 16:18:41.976733 tst iperf3.py:8: start network... 16:18:42.185431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:42.666701 run create_hlr_db(pid=21591): Launched 16:18:42.795121 bus /gobi_6: Setting Powered False 16:18:43.856865 run create_hlr_db(pid=21591): Terminated: ok {rc=0} 16:18:44.290448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21593): Launched 16:18:44.602216 run osmo-hlr_10.42.42.2(pid=21594): Launched 16:18:44.720796 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:45.366347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21596): Launched 16:18:45.671837 run osmo-stp_10.42.42.5(pid=21597): Launched 16:18:45.790107 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:18:46.451504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21599): Launched 16:18:46.592375 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:18:46.880160 run patchelf(pid=21600): Launched 16:18:47.072907 run osmo-stp_10.42.42.5(pid=21597): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21597)] 16:18:47.216627 run osmo-stp_10.42.42.5(pid=21597): stdout: | (launched: 2022-12-09_16:18:45.615836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:47.357944 run osmo-stp_10.42.42.5(pid=21597): stderr: | [0;m[38;5;43m20221209161845788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161845788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161845788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161845789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161845791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161845791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161845791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:47.499064 run osmo-stp_10.42.42.5(pid=21597): stdout: | (launched: 2022-12-09_16:18:45.615836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:47.633282 run osmo-stp_10.42.42.5(pid=21597): stderr: | [0;m[38;5;43m20221209161845788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161845788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161845788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161845789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161845791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161845791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161845791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:47.792237 run patchelf(pid=21600): Terminating (SIGINT) 16:18:47.975370 run patchelf(pid=21600): Terminated: ok {rc=0} 16:18:48.108174 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21597): Process ended prematurely: osmo-stp_10.42.42.5(pid=21597) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21597)] [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 16:18:48.118742 tst iperf3.py:8: Test FAILED (7.9 sec) 16:18:48.148758 run osmo-hlr_10.42.42.2(pid=21594): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21594)] 16:18:48.199276 run osmo-hlr_10.42.42.2(pid=21594): stdout: | (launched: 2022-12-09_16:18:44.544354) 16:18:48.251558 run osmo-hlr_10.42.42.2(pid=21594): stderr: | [0;m[1;31m20221209161844721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161844722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161844722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161844722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161844722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161844722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161844734 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161844742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161844742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161844742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:48.304129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21589): Terminating (SIGTERM) 16:18:48.346703 run iperf3-srv_10.42.42.10(pid=21590): Terminating (SIGTERM) 16:18:48.389301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21593): Terminating (SIGTERM) 16:18:48.432116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21596): Terminating (SIGTERM) 16:18:48.474887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21599): Terminating (SIGTERM) 16:18:48.517794 --- ParallelTerminationStrategy: PID 21589 died... 16:18:48.537823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21589): Terminated: ok {rc=0} 16:18:48.585280 --- ParallelTerminationStrategy: PID 21590 died... 16:18:48.604890 run iperf3-srv_10.42.42.10(pid=21590): Terminated {rc=256} 16:18:48.651747 --- ParallelTerminationStrategy: PID 21593 died... 16:18:48.671510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21593): Terminated: ok {rc=0} 16:18:48.718306 --- ParallelTerminationStrategy: PID 21596 died... 16:18:48.738047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21596): Terminated: ok {rc=0} 16:18:48.784727 --- ParallelTerminationStrategy: PID 21599 died... 16:18:48.804329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21599): Terminated: ok {rc=0} 16:18:48.892767 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:18:50.042514 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:50.054934 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:18:50.127658 tst iperf3m4.py: using LAC 22236 16:18:50.249782 tst iperf3m4.py: using RAC 51 16:18:50.369198 tst iperf3m4.py: using CellId 22236 16:18:50.489078 tst iperf3m4.py: using BVCI 22237 16:18:50.601067 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:50.612006 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:50.622703 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:50.633660 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:50.644348 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:50.655110 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:50.665905 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:50.676430 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:18:50.687321 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:18:50.807282 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:18:50.927227 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:18:51.048860 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:18:51.168565 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:18:51.375476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:51.682996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21601): Launched 16:18:51.952882 run iperf3-srv_10.42.42.10(pid=21602): Launched 16:18:52.067371 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:18:52.273207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:52.581208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21603): Launched 16:18:52.848333 run iperf3-srv_10.42.42.10(pid=21604): Launched 16:18:52.962808 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:18:53.168066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:53.476663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21605): Launched 16:18:53.743563 run iperf3-srv_10.42.42.10(pid=21606): Launched 16:18:53.858937 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:18:54.064018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:18:54.372122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21607): Launched 16:18:54.638997 run iperf3-srv_10.42.42.10(pid=21608): Launched 16:18:54.755052 tst iperf3m4.py:8: start network... 16:18:54.959506 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:55.435007 run create_hlr_db(pid=21609): Launched 16:18:55.559540 bus /gobi_6: Setting Powered False 16:18:56.619765 run create_hlr_db(pid=21609): Terminated: ok {rc=0} 16:18:57.067322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21611): Launched 16:18:57.395950 run osmo-hlr_10.42.42.2(pid=21612): Launched 16:18:57.521489 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:58.081715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21614): Launched 16:18:58.407853 run osmo-stp_10.42.42.5(pid=21615): Launched 16:18:58.534368 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:18:59.096097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21617): Launched 16:18:59.221645 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:18:59.498333 run patchelf(pid=21618): Launched 16:18:59.681433 run osmo-stp_10.42.42.5(pid=21615): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21615)] 16:18:59.820032 run osmo-stp_10.42.42.5(pid=21615): stdout: | (launched: 2022-12-09_16:18:58.348082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:59.959797 run osmo-stp_10.42.42.5(pid=21615): stderr: | [0;m[38;5;43m20221209161858542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161858542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161858542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161858543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161858543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161858543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161858543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:00.099851 run osmo-stp_10.42.42.5(pid=21615): stdout: | (launched: 2022-12-09_16:18:58.348082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:00.233295 run osmo-stp_10.42.42.5(pid=21615): stderr: | [0;m[38;5;43m20221209161858542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161858542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161858542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161858543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161858543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161858543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161858543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:00.391788 run patchelf(pid=21618): Terminating (SIGINT) 16:19:00.575091 run patchelf(pid=21618): Terminated: ok {rc=0} 16:19:00.706798 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21615): Process ended prematurely: osmo-stp_10.42.42.5(pid=21615) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21615)] [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:19:00.717044 tst iperf3m4.py:8: Test FAILED (10.7 sec) 16:19:00.746692 run osmo-hlr_10.42.42.2(pid=21612): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21612)] 16:19:00.797629 run osmo-hlr_10.42.42.2(pid=21612): stdout: | (launched: 2022-12-09_16:18:57.335675) 16:19:00.851941 run osmo-hlr_10.42.42.2(pid=21612): stderr: | [0;m[1;31m20221209161857534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161857534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161857534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161857534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161857534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161857534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161857547 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161857556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161857556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161857557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:00.912623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21601): Terminating (SIGTERM) 16:19:00.957853 run iperf3-srv_10.42.42.10(pid=21602): Terminating (SIGTERM) 16:19:01.004912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21603): Terminating (SIGTERM) 16:19:01.049468 run iperf3-srv_10.42.42.10(pid=21604): Terminating (SIGTERM) 16:19:01.096520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21605): Terminating (SIGTERM) 16:19:01.141525 run iperf3-srv_10.42.42.10(pid=21606): Terminating (SIGTERM) 16:19:01.188549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21607): Terminating (SIGTERM) 16:19:01.233604 run iperf3-srv_10.42.42.10(pid=21608): Terminating (SIGTERM) 16:19:01.280714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21611): Terminating (SIGTERM) 16:19:01.325559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21614): Terminating (SIGTERM) 16:19:01.369955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21617): Terminating (SIGTERM) 16:19:01.414716 --- ParallelTerminationStrategy: PID 21601 died... 16:19:01.435333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21601): Terminated: ok {rc=0} 16:19:01.485049 --- ParallelTerminationStrategy: PID 21602 died... 16:19:01.505480 run iperf3-srv_10.42.42.10(pid=21602): Terminated {rc=256} 16:19:01.554908 --- ParallelTerminationStrategy: PID 21603 died... 16:19:01.575355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21603): Terminated: ok {rc=0} 16:19:01.625266 --- ParallelTerminationStrategy: PID 21604 died... 16:19:01.645730 run iperf3-srv_10.42.42.10(pid=21604): Terminated {rc=256} 16:19:01.695113 --- ParallelTerminationStrategy: PID 21605 died... 16:19:01.715616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21605): Terminated: ok {rc=0} 16:19:01.765226 --- ParallelTerminationStrategy: PID 21606 died... 16:19:01.785673 run iperf3-srv_10.42.42.10(pid=21606): Terminated {rc=256} 16:19:01.835149 --- ParallelTerminationStrategy: PID 21607 died... 16:19:01.855993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21607): Terminated: ok {rc=0} 16:19:01.906163 --- ParallelTerminationStrategy: PID 21608 died... 16:19:01.926588 run iperf3-srv_10.42.42.10(pid=21608): Terminated {rc=256} 16:19:01.976117 --- ParallelTerminationStrategy: PID 21611 died... 16:19:01.996653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21611): Terminated: ok {rc=0} 16:19:02.046221 --- ParallelTerminationStrategy: PID 21614 died... 16:19:02.066797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21614): Terminated: ok {rc=0} 16:19:02.116278 --- ParallelTerminationStrategy: PID 21617 died... 16:19:02.137128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21617): Terminated: ok {rc=0} 16:19:02.229153 bus /gobi_4: Setting Powered False 16:19:03.331366 bus /gobi_4: Setting Powered False 16:19:04.448411 bus /gobi_1: Setting Powered False 16:19:05.546723 bus /gobi_1: Setting Powered False 16:19:06.662351 bus /gobi_0: Setting Powered False 16:19:07.762164 bus /gobi_0: Setting Powered False 16:19:08.877498 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:19:09.980361 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:09.992172 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:19:10.061295 tst ping.py: using LAC 22237 16:19:10.188046 tst ping.py: using RAC 52 16:19:10.312931 tst ping.py: using CellId 22237 16:19:10.438988 tst ping.py: using BVCI 22238 16:19:10.557571 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:10.569208 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:10.580613 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:10.592729 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:10.604666 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:10.616709 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:10.628734 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:10.640683 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:19:10.759472 tst ping.py:19: start network... 16:19:10.962508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:11.434317 run create_hlr_db(pid=21619): Launched 16:19:11.560014 bus /gobi_6: Setting Powered False 16:19:12.621038 run create_hlr_db(pid=21619): Terminated: ok {rc=0} 16:19:13.070833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21621): Launched 16:19:13.393335 run osmo-hlr_10.42.42.2(pid=21622): Launched 16:19:13.516852 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:14.039427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21624): Launched 16:19:14.340682 run osmo-stp_10.42.42.5(pid=21625): Launched 16:19:14.458477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:19:14.977415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21627): Launched 16:19:15.091658 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:19:15.345258 run patchelf(pid=21628): Launched 16:19:15.513221 run osmo-stp_10.42.42.5(pid=21625): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21625)] 16:19:15.640233 run osmo-stp_10.42.42.5(pid=21625): stdout: | (launched: 2022-12-09_16:19:14.284904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:15.769182 run osmo-stp_10.42.42.5(pid=21625): stderr: | [0;m[38;5;43m20221209161914456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161914456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161914456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161914457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161914459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161914459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161914459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:15.916777 run osmo-stp_10.42.42.5(pid=21625): stdout: | (launched: 2022-12-09_16:19:14.284904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:16.042404 run osmo-stp_10.42.42.5(pid=21625): stderr: | [0;m[38;5;43m20221209161914456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161914456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161914456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161914457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161914459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161914459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161914459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:16.190988 run patchelf(pid=21628): Terminating (SIGINT) 16:19:16.361928 run patchelf(pid=21628): Terminated: ok {rc=0} 16:19:16.488518 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21625): Process ended prematurely: osmo-stp_10.42.42.5(pid=21625) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21625)] [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 16:19:16.498211 tst ping.py:22: Test FAILED (6.5 sec) 16:19:16.525525 run osmo-hlr_10.42.42.2(pid=21622): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21622)] 16:19:16.574899 run osmo-hlr_10.42.42.2(pid=21622): stdout: | (launched: 2022-12-09_16:19:13.333970) 16:19:16.625680 run osmo-hlr_10.42.42.2(pid=21622): stderr: | [0;m[1;31m20221209161913534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161913534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161913534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161913534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161913534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161913534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161913546 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161913555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161913555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161913555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:16.676302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21621): Terminating (SIGTERM) 16:19:16.717560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21624): Terminating (SIGTERM) 16:19:16.760234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21627): Terminating (SIGTERM) 16:19:16.801137 --- ParallelTerminationStrategy: PID 21621 died... 16:19:16.820258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21621): Terminated: ok {rc=0} 16:19:16.865487 --- ParallelTerminationStrategy: PID 21624 died... 16:19:16.884556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21624): Terminated: ok {rc=0} 16:19:16.929148 --- ParallelTerminationStrategy: PID 21627 died... 16:19:16.948562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21627): Terminated: ok {rc=0} 16:19:17.038494 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:19:18.134679 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:18.146398 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:19:18.220140 tst ping_idle_ping.py: using LAC 22238 16:19:18.339134 tst ping_idle_ping.py: using RAC 53 16:19:18.458894 tst ping_idle_ping.py: using CellId 22238 16:19:18.586026 tst ping_idle_ping.py: using BVCI 22239 16:19:18.704423 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:18.716084 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:18.727583 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:18.739449 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:18.751074 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:18.763417 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:18.775367 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:19:18.787154 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:19:18.903685 tst ping_idle_ping.py:24: start network... 16:19:19.106796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:19.573681 run create_hlr_db(pid=21629): Launched 16:19:19.697154 bus /gobi_6: Setting Powered False 16:19:20.757525 run create_hlr_db(pid=21629): Terminated: ok {rc=0} 16:19:21.198022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21631): Launched 16:19:21.523715 run osmo-hlr_10.42.42.2(pid=21632): Launched 16:19:21.650103 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:22.207533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21634): Launched 16:19:22.534388 run osmo-stp_10.42.42.5(pid=21635): Launched 16:19:22.657933 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:19:23.213728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21637): Launched 16:19:23.336781 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:19:23.609678 run patchelf(pid=21638): Launched 16:19:23.788621 run osmo-stp_10.42.42.5(pid=21635): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21635)] 16:19:23.924657 run osmo-stp_10.42.42.5(pid=21635): stdout: | (launched: 2022-12-09_16:19:22.474670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:24.063256 run osmo-stp_10.42.42.5(pid=21635): stderr: | [0;m[38;5;43m20221209161922668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161922669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161922669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161922669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161922670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161922670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161922670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:24.201751 run osmo-stp_10.42.42.5(pid=21635): stdout: | (launched: 2022-12-09_16:19:22.474670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:24.333855 run osmo-stp_10.42.42.5(pid=21635): stderr: | [0;m[38;5;43m20221209161922668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161922669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161922669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161922669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161922670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161922670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161922670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:24.491024 run patchelf(pid=21638): Terminating (SIGINT) 16:19:24.671791 run patchelf(pid=21638): Terminated: ok {rc=0} 16:19:24.802131 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21635): Process ended prematurely: osmo-stp_10.42.42.5(pid=21635) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21635)] [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:19:24.811695 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:19:24.840452 run osmo-hlr_10.42.42.2(pid=21632): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21632)] 16:19:24.890364 run osmo-hlr_10.42.42.2(pid=21632): stdout: | (launched: 2022-12-09_16:19:21.463935) 16:19:24.942325 run osmo-hlr_10.42.42.2(pid=21632): stderr: | [0;m[1;31m20221209161921664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161921664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161921664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161921664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161921664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161921664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161921679 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161921689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161921689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161921689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:24.994879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21631): Terminating (SIGTERM) 16:19:25.037099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21634): Terminating (SIGTERM) 16:19:25.079252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21637): Terminating (SIGTERM) 16:19:25.121521 --- ParallelTerminationStrategy: PID 21631 died... 16:19:25.141399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21631): Terminated: ok {rc=0} 16:19:25.188401 --- ParallelTerminationStrategy: PID 21634 died... 16:19:25.207897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21634): Terminated: ok {rc=0} 16:19:25.254771 --- ParallelTerminationStrategy: PID 21637 died... 16:19:25.274601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21637): Terminated: ok {rc=0} 16:19:25.363838 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:19:26.673639 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:19:26.680695 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:19:26.715834 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:19:26.756159 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:19:26.846180 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:19:26.880004 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:19:26.920049 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:19:27.517275 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:19:27.570838 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:27.582590 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:19:27.654850 tst cs_paging_gprs_active.py: using LAC 22239 16:19:27.784559 tst cs_paging_gprs_active.py: using RAC 54 16:19:27.911892 tst cs_paging_gprs_active.py: using CellId 22239 16:19:28.043169 tst cs_paging_gprs_active.py: using BVCI 22240 16:19:28.163740 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.175204 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.186521 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.198391 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.210161 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.222165 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.234575 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.246392 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:28.258267 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:19:28.377249 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:19:28.498938 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:19:28.708162 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:29.019052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21642): Launched 16:19:29.290790 run iperf3-srv_10.42.42.10(pid=21643): Launched 16:19:29.409199 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:19:29.618182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:29.930465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21644): Launched 16:19:30.200686 run iperf3-srv_10.42.42.10(pid=21645): Launched 16:19:30.316318 tst cs_paging_gprs_active.py:38: start network... 16:19:30.523339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:31.018295 run create_hlr_db(pid=21646): Launched 16:19:31.175578 bus /gobi_6: Setting Powered False 16:19:32.237782 run create_hlr_db(pid=21646): Terminated: ok {rc=0} 16:19:32.690889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21648): Launched 16:19:33.020016 run osmo-hlr_10.42.42.2(pid=21649): Launched 16:19:33.145680 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:33.713425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21651): Launched 16:19:34.042392 run osmo-stp_10.42.42.5(pid=21652): Launched 16:19:34.168934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:19:34.736352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21654): Launched 16:19:34.863958 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:19:35.144344 run patchelf(pid=21655): Launched 16:19:35.328109 run osmo-stp_10.42.42.5(pid=21652): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21652)] 16:19:35.467716 run osmo-stp_10.42.42.5(pid=21652): stdout: | (launched: 2022-12-09_16:19:33.982484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:35.608597 run osmo-stp_10.42.42.5(pid=21652): stderr: | [0;m[38;5;43m20221209161934175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161934175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161934175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161934176 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161934176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161934176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161934176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:35.749508 run osmo-stp_10.42.42.5(pid=21652): stdout: | (launched: 2022-12-09_16:19:33.982484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:35.883925 run osmo-stp_10.42.42.5(pid=21652): stderr: | [0;m[38;5;43m20221209161934175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161934175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161934175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161934176 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161934176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161934176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161934176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:36.043223 run patchelf(pid=21655): Terminating (SIGINT) 16:19:36.227559 run patchelf(pid=21655): Terminated: ok {rc=0} 16:19:36.360918 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21652): Process ended prematurely: osmo-stp_10.42.42.5(pid=21652) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21652)] [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:19:36.371490 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 16:19:36.400576 run osmo-hlr_10.42.42.2(pid=21649): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21649)] 16:19:36.451047 run osmo-hlr_10.42.42.2(pid=21649): stdout: | (launched: 2022-12-09_16:19:32.959855) 16:19:36.503295 run osmo-hlr_10.42.42.2(pid=21649): stderr: | [0;m[1;31m20221209161933162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161933162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161933162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161933162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161933162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161933162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161933178 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161933187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161933188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161933188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:36.555861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21642): Terminating (SIGTERM) 16:19:36.598191 run iperf3-srv_10.42.42.10(pid=21643): Terminating (SIGTERM) 16:19:36.640421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21644): Terminating (SIGTERM) 16:19:36.682831 run iperf3-srv_10.42.42.10(pid=21645): Terminating (SIGTERM) 16:19:36.724833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21648): Terminating (SIGTERM) 16:19:36.767159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21651): Terminating (SIGTERM) 16:19:36.809498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21654): Terminating (SIGTERM) 16:19:36.851794 --- ParallelTerminationStrategy: PID 21642 died... 16:19:36.871881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21642): Terminated: ok {rc=0} 16:19:36.918954 --- ParallelTerminationStrategy: PID 21643 died... 16:19:36.938529 run iperf3-srv_10.42.42.10(pid=21643): Terminated {rc=256} 16:19:36.985353 --- ParallelTerminationStrategy: PID 21644 died... 16:19:37.004931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21644): Terminated: ok {rc=0} 16:19:37.051655 --- ParallelTerminationStrategy: PID 21645 died... 16:19:37.071128 run iperf3-srv_10.42.42.10(pid=21645): Terminated {rc=256} 16:19:37.117581 --- ParallelTerminationStrategy: PID 21648 died... 16:19:37.137120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21648): Terminated: ok {rc=0} 16:19:37.183549 --- ParallelTerminationStrategy: PID 21651 died... 16:19:37.203126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21651): Terminated: ok {rc=0} 16:19:37.249524 --- ParallelTerminationStrategy: PID 21654 died... 16:19:37.269109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21654): Terminated: ok {rc=0} 16:19:37.357937 bus /gobi_0: Setting Powered False 16:19:38.457600 bus /gobi_0: Setting Powered False 16:19:39.573681 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:19:40.718147 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:40.729865 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:19:40.799986 tst iperf3.py: using LAC 22240 16:19:40.920181 tst iperf3.py: using RAC 55 16:19:41.044366 tst iperf3.py: using CellId 22240 16:19:41.164182 tst iperf3.py: using BVCI 22241 16:19:41.274724 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:41.285758 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:41.296582 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:41.307390 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:41.318180 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:41.329050 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:41.339896 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:41.350585 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:41.361459 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:19:41.478658 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:19:41.703674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:42.034119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21656): Launched 16:19:42.322603 run iperf3-srv_10.42.42.10(pid=21657): Launched 16:19:42.446357 tst iperf3.py:8: start network... 16:19:42.668923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:43.176477 run create_hlr_db(pid=21658): Launched 16:19:43.303428 bus /gobi_6: Setting Powered False 16:19:44.367844 run create_hlr_db(pid=21658): Terminated: ok {rc=0} 16:19:44.806622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21660): Launched 16:19:45.113879 run osmo-hlr_10.42.42.2(pid=21661): Launched 16:19:45.230606 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:45.778152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21663): Launched 16:19:46.095647 run osmo-stp_10.42.42.5(pid=21664): Launched 16:19:46.331932 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:19:47.037784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21666): Launched 16:19:47.193404 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:19:47.474684 run patchelf(pid=21667): Launched 16:19:47.657842 run osmo-stp_10.42.42.5(pid=21664): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21664)] 16:19:47.797088 run osmo-stp_10.42.42.5(pid=21664): stdout: | (launched: 2022-12-09_16:19:46.037873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:47.937633 run osmo-stp_10.42.42.5(pid=21664): stderr: | [0;m[38;5;43m20221209161946360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161946360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161946369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161946370 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161946372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161946372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161946372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:48.078175 run osmo-stp_10.42.42.5(pid=21664): stdout: | (launched: 2022-12-09_16:19:46.037873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:48.211961 run osmo-stp_10.42.42.5(pid=21664): stderr: | [0;m[38;5;43m20221209161946360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161946360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161946369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161946370 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161946372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161946372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161946372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:48.371469 run patchelf(pid=21667): Terminating (SIGINT) 16:19:48.556096 run patchelf(pid=21667): Terminated: ok {rc=0} 16:19:48.689394 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21664): Process ended prematurely: osmo-stp_10.42.42.5(pid=21664) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21664)] [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 16:19:48.699876 tst iperf3.py:8: Test FAILED (8.0 sec) 16:19:48.729211 run osmo-hlr_10.42.42.2(pid=21661): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21661)] 16:19:48.779552 run osmo-hlr_10.42.42.2(pid=21661): stdout: | (launched: 2022-12-09_16:19:45.057086) 16:19:48.831740 run osmo-hlr_10.42.42.2(pid=21661): stderr: | [0;m[1;31m20221209161945235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161945235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161945235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161945235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161945235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161945235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161945247 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161945258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161945258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161945258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:48.884327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21656): Terminating (SIGTERM) 16:19:48.926521 run iperf3-srv_10.42.42.10(pid=21657): Terminating (SIGTERM) 16:19:48.968586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21660): Terminating (SIGTERM) 16:19:49.010913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21663): Terminating (SIGTERM) 16:19:49.053107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21666): Terminating (SIGTERM) 16:19:49.095232 --- ParallelTerminationStrategy: PID 21656 died... 16:19:49.115191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21656): Terminated: ok {rc=0} 16:19:49.162121 --- ParallelTerminationStrategy: PID 21657 died... 16:19:49.181672 run iperf3-srv_10.42.42.10(pid=21657): Terminated {rc=256} 16:19:49.228246 --- ParallelTerminationStrategy: PID 21660 died... 16:19:49.247907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21660): Terminated: ok {rc=0} 16:19:49.294553 --- ParallelTerminationStrategy: PID 21663 died... 16:19:49.314222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21663): Terminated: ok {rc=0} 16:19:49.360934 --- ParallelTerminationStrategy: PID 21666 died... 16:19:49.380560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21666): Terminated: ok {rc=0} 16:19:49.470819 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:19:50.623791 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:50.636182 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:19:50.709143 tst iperf3m4.py: using LAC 22241 16:19:50.838396 tst iperf3m4.py: using RAC 56 16:19:50.967629 tst iperf3m4.py: using CellId 22241 16:19:51.095177 tst iperf3m4.py: using BVCI 22242 16:19:51.213836 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:51.225488 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:51.236860 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:51.248615 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:51.260108 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:51.271890 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:51.283536 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:51.294865 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:19:51.306836 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:19:51.426570 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:19:51.552087 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:19:51.670268 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:19:51.791992 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:19:52.015394 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:52.344876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21669): Launched 16:19:52.631697 run iperf3-srv_10.42.42.10(pid=21670): Launched 16:19:52.754997 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:19:52.977782 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:53.307292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21671): Launched 16:19:53.595287 run iperf3-srv_10.42.42.10(pid=21672): Launched 16:19:53.719752 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:19:53.942531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:54.272456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21673): Launched 16:19:54.559431 run iperf3-srv_10.42.42.10(pid=21674): Launched 16:19:54.683444 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:19:54.905881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:19:55.235339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21675): Launched 16:19:55.523619 run iperf3-srv_10.42.42.10(pid=21676): Launched 16:19:55.647922 tst iperf3m4.py:8: start network... 16:19:55.870216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:56.378616 run create_hlr_db(pid=21677): Launched 16:19:56.505329 bus /gobi_6: Setting Powered False 16:19:57.570178 run create_hlr_db(pid=21677): Terminated: ok {rc=0} 16:19:58.010292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21679): Launched 16:19:58.321650 run osmo-hlr_10.42.42.2(pid=21680): Launched 16:19:58.439271 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:58.986158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21682): Launched 16:19:59.293682 run osmo-stp_10.42.42.5(pid=21683): Launched 16:19:59.411142 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:19:59.941092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21685): Launched 16:20:00.059217 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:00.319263 run patchelf(pid=21686): Launched 16:20:00.492632 run osmo-stp_10.42.42.5(pid=21683): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21683)] 16:20:00.622877 run osmo-stp_10.42.42.5(pid=21683): stdout: | (launched: 2022-12-09_16:19:59.236916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:00.755066 run osmo-stp_10.42.42.5(pid=21683): stderr: | [0;m[38;5;43m20221209161959411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161959411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161959411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161959412 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161959412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161959412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161959412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:00.898300 run osmo-stp_10.42.42.5(pid=21683): stdout: | (launched: 2022-12-09_16:19:59.236916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:01.040684 run osmo-stp_10.42.42.5(pid=21683): stderr: | [0;m[38;5;43m20221209161959411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209161959411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209161959411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209161959412 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209161959412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209161959412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209161959412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:01.193693 run patchelf(pid=21686): Terminating (SIGINT) 16:20:01.371005 run patchelf(pid=21686): Terminated: ok {rc=0} 16:20:01.499577 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21683): Process ended prematurely: osmo-stp_10.42.42.5(pid=21683) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21683)] [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:20:01.509958 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:20:01.539150 run osmo-hlr_10.42.42.2(pid=21680): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21680)] 16:20:01.599598 run osmo-hlr_10.42.42.2(pid=21680): stdout: | (launched: 2022-12-09_16:19:58.263717) 16:20:01.651427 run osmo-hlr_10.42.42.2(pid=21680): stderr: | [0;m[1;31m20221209161958441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209161958441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209161958441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209161958441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209161958441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209161958442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209161958454 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209161958462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209161958462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209161958462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:01.703266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21669): Terminating (SIGTERM) 16:20:01.746227 run iperf3-srv_10.42.42.10(pid=21670): Terminating (SIGTERM) 16:20:01.791126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21671): Terminating (SIGTERM) 16:20:01.833240 run iperf3-srv_10.42.42.10(pid=21672): Terminating (SIGTERM) 16:20:01.877751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21673): Terminating (SIGTERM) 16:20:01.919864 run iperf3-srv_10.42.42.10(pid=21674): Terminating (SIGTERM) 16:20:01.963890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21675): Terminating (SIGTERM) 16:20:02.005843 run iperf3-srv_10.42.42.10(pid=21676): Terminating (SIGTERM) 16:20:02.050451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21679): Terminating (SIGTERM) 16:20:02.092490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21682): Terminating (SIGTERM) 16:20:02.133661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21685): Terminating (SIGTERM) 16:20:02.174321 --- ParallelTerminationStrategy: PID 21669 died... 16:20:02.193572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21669): Terminated: ok {rc=0} 16:20:02.238294 --- ParallelTerminationStrategy: PID 21670 died... 16:20:02.257223 run iperf3-srv_10.42.42.10(pid=21670): Terminated {rc=256} 16:20:02.300534 --- ParallelTerminationStrategy: PID 21671 died... 16:20:02.319042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21671): Terminated: ok {rc=0} 16:20:02.362443 --- ParallelTerminationStrategy: PID 21672 died... 16:20:02.380754 run iperf3-srv_10.42.42.10(pid=21672): Terminated {rc=256} 16:20:02.424195 --- ParallelTerminationStrategy: PID 21673 died... 16:20:02.442631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21673): Terminated: ok {rc=0} 16:20:02.486373 --- ParallelTerminationStrategy: PID 21674 died... 16:20:02.504843 run iperf3-srv_10.42.42.10(pid=21674): Terminated {rc=256} 16:20:02.548603 --- ParallelTerminationStrategy: PID 21675 died... 16:20:02.567102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21675): Terminated: ok {rc=0} 16:20:02.610466 --- ParallelTerminationStrategy: PID 21676 died... 16:20:02.628898 run iperf3-srv_10.42.42.10(pid=21676): Terminated {rc=256} 16:20:02.672369 --- ParallelTerminationStrategy: PID 21679 died... 16:20:02.690857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21679): Terminated: ok {rc=0} 16:20:02.734145 --- ParallelTerminationStrategy: PID 21682 died... 16:20:02.752622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21682): Terminated: ok {rc=0} 16:20:02.795958 --- ParallelTerminationStrategy: PID 21685 died... 16:20:02.814431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21685): Terminated: ok {rc=0} 16:20:02.897400 bus /gobi_4: Setting Powered False 16:20:03.992833 bus /gobi_4: Setting Powered False 16:20:05.107318 bus /gobi_1: Setting Powered False 16:20:06.205850 bus /gobi_1: Setting Powered False 16:20:07.320666 bus /gobi_0: Setting Powered False 16:20:08.421111 bus /gobi_0: Setting Powered False 16:20:09.539872 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:20:10.642654 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:10.655093 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:20:10.729268 tst ping.py: using LAC 22242 16:20:10.850022 tst ping.py: using RAC 57 16:20:10.969341 tst ping.py: using CellId 22242 16:20:11.086922 tst ping.py: using BVCI 22243 16:20:11.195459 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:11.206496 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:11.217317 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:11.228599 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:11.239938 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:11.251230 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:11.262596 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:11.273384 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:20:11.392019 tst ping.py:19: start network... 16:20:11.609636 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:12.108432 run create_hlr_db(pid=21696): Launched 16:20:12.232415 bus /gobi_6: Setting Powered False 16:20:13.296638 run create_hlr_db(pid=21696): Terminated: ok {rc=0} 16:20:13.727301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21698): Launched 16:20:14.030065 run osmo-hlr_10.42.42.2(pid=21699): Launched 16:20:14.144287 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:14.661327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21701): Launched 16:20:14.961579 run osmo-stp_10.42.42.5(pid=21702): Launched 16:20:15.075672 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:15.594113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21704): Launched 16:20:15.709203 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:15.977613 run patchelf(pid=21705): Launched 16:20:16.148352 run osmo-stp_10.42.42.5(pid=21702): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21702)] 16:20:16.278600 run osmo-stp_10.42.42.5(pid=21702): stdout: | (launched: 2022-12-09_16:20:14.905888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:16.410446 run osmo-stp_10.42.42.5(pid=21702): stderr: | [0;m[38;5;43m20221209162015077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162015077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162015078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162015078 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162015078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162015078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162015078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:16.542175 run osmo-stp_10.42.42.5(pid=21702): stdout: | (launched: 2022-12-09_16:20:14.905888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:16.667735 run osmo-stp_10.42.42.5(pid=21702): stderr: | [0;m[38;5;43m20221209162015077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162015077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162015078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162015078 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162015078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162015078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162015078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:16.817993 run patchelf(pid=21705): Terminating (SIGINT) 16:20:16.989450 run patchelf(pid=21705): Terminated: ok {rc=0} 16:20:17.113185 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21702): Process ended prematurely: osmo-stp_10.42.42.5(pid=21702) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21702)] [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 16:20:17.122638 tst ping.py:22: Test FAILED (6.5 sec) 16:20:17.150533 run osmo-hlr_10.42.42.2(pid=21699): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21699)] 16:20:17.199414 run osmo-hlr_10.42.42.2(pid=21699): stdout: | (launched: 2022-12-09_16:20:13.974141) 16:20:17.249564 run osmo-hlr_10.42.42.2(pid=21699): stderr: | [0;m[1;31m20221209162014153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162014153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162014153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162014153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162014153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162014153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162014166 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162014176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162014177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162014177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:17.299429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21698): Terminating (SIGTERM) 16:20:17.339387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21701): Terminating (SIGTERM) 16:20:17.379175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21704): Terminating (SIGTERM) 16:20:17.419286 --- ParallelTerminationStrategy: PID 21698 died... 16:20:17.437975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21698): Terminated: ok {rc=0} 16:20:17.482063 --- ParallelTerminationStrategy: PID 21701 died... 16:20:17.500585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21701): Terminated: ok {rc=0} 16:20:17.544668 --- ParallelTerminationStrategy: PID 21704 died... 16:20:17.563396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21704): Terminated: ok {rc=0} 16:20:17.649359 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:20:18.738976 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:18.751216 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:20:18.825019 tst ping_idle_ping.py: using LAC 22243 16:20:18.944020 tst ping_idle_ping.py: using RAC 58 16:20:19.063655 tst ping_idle_ping.py: using CellId 22243 16:20:19.181320 tst ping_idle_ping.py: using BVCI 22244 16:20:19.290271 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:19.301298 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:19.312244 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:19.323107 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:19.333838 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:19.344576 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:19.355511 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:20:19.366369 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:20:19.481778 tst ping_idle_ping.py:24: start network... 16:20:19.683807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:20.150597 run create_hlr_db(pid=21707): Launched 16:20:20.275282 bus /gobi_6: Setting Powered False 16:20:21.335002 run create_hlr_db(pid=21707): Terminated: ok {rc=0} 16:20:21.777096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21709): Launched 16:20:22.102387 run osmo-hlr_10.42.42.2(pid=21710): Launched 16:20:22.226996 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:22.781433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21712): Launched 16:20:23.104845 run osmo-stp_10.42.42.5(pid=21713): Launched 16:20:23.230067 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:23.788654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21715): Launched 16:20:23.913897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:24.188043 run patchelf(pid=21716): Launched 16:20:24.367520 run osmo-stp_10.42.42.5(pid=21713): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21713)] 16:20:24.505498 run osmo-stp_10.42.42.5(pid=21713): stdout: | (launched: 2022-12-09_16:20:23.045528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:24.644765 run osmo-stp_10.42.42.5(pid=21713): stderr: | [0;m[38;5;43m20221209162023236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162023236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162023237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162023237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162023238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162023238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162023238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:24.783816 run osmo-stp_10.42.42.5(pid=21713): stdout: | (launched: 2022-12-09_16:20:23.045528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:24.916746 run osmo-stp_10.42.42.5(pid=21713): stderr: | [0;m[38;5;43m20221209162023236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162023236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162023237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162023237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162023238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162023238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162023238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:25.074538 run patchelf(pid=21716): Terminating (SIGINT) 16:20:25.255407 run patchelf(pid=21716): Terminated: ok {rc=0} 16:20:25.386013 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21713): Process ended prematurely: osmo-stp_10.42.42.5(pid=21713) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21713)] [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:20:25.395635 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:20:25.424395 run osmo-hlr_10.42.42.2(pid=21710): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21710)] 16:20:25.475542 run osmo-hlr_10.42.42.2(pid=21710): stdout: | (launched: 2022-12-09_16:20:22.043197) 16:20:25.527928 run osmo-hlr_10.42.42.2(pid=21710): stderr: | [0;m[1;31m20221209162022241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162022241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162022241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162022241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162022241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162022241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162022254 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162022262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162022262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162022263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:25.580764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21709): Terminating (SIGTERM) 16:20:25.623260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21712): Terminating (SIGTERM) 16:20:25.665558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21715): Terminating (SIGTERM) 16:20:25.707864 --- ParallelTerminationStrategy: PID 21709 died... 16:20:25.727985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21709): Terminated: ok {rc=0} 16:20:25.774844 --- ParallelTerminationStrategy: PID 21712 died... 16:20:25.794534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21712): Terminated: ok {rc=0} 16:20:25.841652 --- ParallelTerminationStrategy: PID 21715 died... 16:20:25.861501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21715): Terminated: ok {rc=0} 16:20:25.951778 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:20:27.251760 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:20:27.258445 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:20:27.290822 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 16:20:27.329479 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 16:20:27.417138 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:20:27.449495 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 16:20:27.487876 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 16:20:28.097162 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 16:20:28.146349 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.157855 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:20:28.209313 tst cs_paging_gprs_active.py: using LAC 22244 16:20:28.328663 tst cs_paging_gprs_active.py: using RAC 59 16:20:28.448224 tst cs_paging_gprs_active.py: using CellId 22244 16:20:28.578193 tst cs_paging_gprs_active.py: using BVCI 22245 16:20:28.697406 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.709719 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.721540 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.733862 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.745677 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.757610 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.769615 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.781357 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:28.793492 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:20:28.914702 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:20:29.034788 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:20:29.241885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:29.551165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21720): Launched 16:20:29.822040 run iperf3-srv_10.42.42.10(pid=21721): Launched 16:20:29.939213 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:20:30.145615 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:30.453944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21722): Launched 16:20:30.723484 run iperf3-srv_10.42.42.10(pid=21723): Launched 16:20:30.839140 tst cs_paging_gprs_active.py:38: start network... 16:20:31.049278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:31.535654 run create_hlr_db(pid=21724): Launched 16:20:31.698605 bus /gobi_6: Setting Powered False 16:20:32.763150 run create_hlr_db(pid=21724): Terminated: ok {rc=0} 16:20:33.224023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21726): Launched 16:20:33.557901 run osmo-hlr_10.42.42.2(pid=21727): Launched 16:20:33.687493 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:34.251880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21729): Launched 16:20:34.583796 run osmo-stp_10.42.42.5(pid=21730): Launched 16:20:34.709657 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:35.276283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21732): Launched 16:20:35.402923 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:35.682945 run patchelf(pid=21733): Launched 16:20:35.867781 run osmo-stp_10.42.42.5(pid=21730): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21730)] 16:20:36.007435 run osmo-stp_10.42.42.5(pid=21730): stdout: | (launched: 2022-12-09_16:20:34.523359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:36.148754 run osmo-stp_10.42.42.5(pid=21730): stderr: | [0;m[38;5;43m20221209162034718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162034718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162034718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162034719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162034719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162034719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162034719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:36.289673 run osmo-stp_10.42.42.5(pid=21730): stdout: | (launched: 2022-12-09_16:20:34.523359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:36.424267 run osmo-stp_10.42.42.5(pid=21730): stderr: | [0;m[38;5;43m20221209162034718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162034718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162034718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162034719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162034719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162034719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162034719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:36.584392 run patchelf(pid=21733): Terminating (SIGINT) 16:20:36.768847 run patchelf(pid=21733): Terminated: ok {rc=0} 16:20:36.901837 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21730): Process ended prematurely: osmo-stp_10.42.42.5(pid=21730) [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21730)] [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 16:20:36.912043 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 16:20:36.941409 run osmo-hlr_10.42.42.2(pid=21727): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21727)] 16:20:36.992274 run osmo-hlr_10.42.42.2(pid=21727): stdout: | (launched: 2022-12-09_16:20:33.496561) 16:20:37.044315 run osmo-hlr_10.42.42.2(pid=21727): stderr: | [0;m[1;31m20221209162033697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162033697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162033697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162033697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162033697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162033697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162033722 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162033731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162033731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162033731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:37.097270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21720): Terminating (SIGTERM) 16:20:37.139401 run iperf3-srv_10.42.42.10(pid=21721): Terminating (SIGTERM) 16:20:37.181560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21722): Terminating (SIGTERM) 16:20:37.223678 run iperf3-srv_10.42.42.10(pid=21723): Terminating (SIGTERM) 16:20:37.265753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21726): Terminating (SIGTERM) 16:20:37.307818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21729): Terminating (SIGTERM) 16:20:37.350185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21732): Terminating (SIGTERM) 16:20:37.392372 --- ParallelTerminationStrategy: PID 21720 died... 16:20:37.412397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21720): Terminated: ok {rc=0} 16:20:37.459193 --- ParallelTerminationStrategy: PID 21721 died... 16:20:37.479014 run iperf3-srv_10.42.42.10(pid=21721): Terminated {rc=256} 16:20:37.525752 --- ParallelTerminationStrategy: PID 21722 died... 16:20:37.545243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21722): Terminated: ok {rc=0} 16:20:37.592002 --- ParallelTerminationStrategy: PID 21723 died... 16:20:37.611564 run iperf3-srv_10.42.42.10(pid=21723): Terminated {rc=256} 16:20:37.657869 --- ParallelTerminationStrategy: PID 21726 died... 16:20:37.677364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21726): Terminated: ok {rc=0} 16:20:37.723680 --- ParallelTerminationStrategy: PID 21729 died... 16:20:37.743185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21729): Terminated: ok {rc=0} 16:20:37.789784 --- ParallelTerminationStrategy: PID 21732 died... 16:20:37.809268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21732): Terminated: ok {rc=0} 16:20:37.896441 bus /gobi_0: Setting Powered False 16:20:38.995808 bus /gobi_0: Setting Powered False 16:20:40.111189 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 16:20:41.261661 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:41.274448 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:20:41.331025 tst iperf3.py: using LAC 22245 16:20:41.458895 tst iperf3.py: using RAC 60 16:20:41.591298 tst iperf3.py: using CellId 22245 16:20:41.719660 tst iperf3.py: using BVCI 22246 16:20:41.838377 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:41.850326 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:41.862000 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:41.874804 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:41.886658 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:41.898733 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:41.911094 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:41.922642 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:41.934891 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:20:42.055005 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:20:42.263851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:42.574788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21734): Launched 16:20:42.847505 run iperf3-srv_10.42.42.10(pid=21735): Launched 16:20:42.963329 tst iperf3.py:8: start network... 16:20:43.171461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:43.647068 run create_hlr_db(pid=21736): Launched 16:20:43.774652 bus /gobi_6: Setting Powered False 16:20:44.835117 run create_hlr_db(pid=21736): Terminated: ok {rc=0} 16:20:45.263341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21738): Launched 16:20:45.571787 run osmo-hlr_10.42.42.2(pid=21739): Launched 16:20:45.689100 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:46.259898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21741): Launched 16:20:46.628421 run osmo-stp_10.42.42.5(pid=21742): Launched 16:20:46.865396 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:47.567886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21744): Launched 16:20:47.687133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:47.948629 run patchelf(pid=21745): Launched 16:20:48.120355 run osmo-stp_10.42.42.5(pid=21742): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21742)] 16:20:48.250763 run osmo-stp_10.42.42.5(pid=21742): stdout: | (launched: 2022-12-09_16:20:46.566349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:48.383153 run osmo-stp_10.42.42.5(pid=21742): stderr: | [0;m[38;5;43m20221209162046883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162046883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162046884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162046884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162046885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162046885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162046885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:48.515633 run osmo-stp_10.42.42.5(pid=21742): stdout: | (launched: 2022-12-09_16:20:46.566349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:48.641625 run osmo-stp_10.42.42.5(pid=21742): stderr: | [0;m[38;5;43m20221209162046883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162046883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162046884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162046884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162046885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162046885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162046885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:48.790640 run patchelf(pid=21745): Terminating (SIGINT) 16:20:48.963535 run patchelf(pid=21745): Terminated: ok {rc=0} 16:20:49.088525 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21742): Process ended prematurely: osmo-stp_10.42.42.5(pid=21742) [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21742)] [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 16:20:49.098140 tst iperf3.py:8: Test FAILED (7.9 sec) 16:20:49.125511 run osmo-hlr_10.42.42.2(pid=21739): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21739)] 16:20:49.173427 run osmo-hlr_10.42.42.2(pid=21739): stdout: | (launched: 2022-12-09_16:20:45.515045) 16:20:49.222987 run osmo-hlr_10.42.42.2(pid=21739): stderr: | [0;m[1;31m20221209162045695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162045695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162045695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162045695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162045695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162045695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162045707 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162045718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162045718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162045718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:49.273043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21734): Terminating (SIGTERM) 16:20:49.312724 run iperf3-srv_10.42.42.10(pid=21735): Terminating (SIGTERM) 16:20:49.352227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21738): Terminating (SIGTERM) 16:20:49.391943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21741): Terminating (SIGTERM) 16:20:49.431610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21744): Terminating (SIGTERM) 16:20:49.471477 --- ParallelTerminationStrategy: PID 21734 died... 16:20:49.490623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21734): Terminated: ok {rc=0} 16:20:49.534372 --- ParallelTerminationStrategy: PID 21735 died... 16:20:49.552766 run iperf3-srv_10.42.42.10(pid=21735): Terminated {rc=256} 16:20:49.596658 --- ParallelTerminationStrategy: PID 21738 died... 16:20:49.615153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21738): Terminated: ok {rc=0} 16:20:49.658719 --- ParallelTerminationStrategy: PID 21741 died... 16:20:49.677262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21741): Terminated: ok {rc=0} 16:20:49.720726 --- ParallelTerminationStrategy: PID 21744 died... 16:20:49.739324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21744): Terminated: ok {rc=0} 16:20:49.824693 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 16:20:50.972537 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:50.984776 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:20:51.036305 tst iperf3m4.py: using LAC 22246 16:20:51.157449 tst iperf3m4.py: using RAC 61 16:20:51.278278 tst iperf3m4.py: using CellId 22246 16:20:51.398299 tst iperf3m4.py: using BVCI 22247 16:20:51.511046 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:51.522500 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:51.533796 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:51.545086 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:51.556247 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:51.567416 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:51.578713 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:51.590307 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:20:51.601793 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:20:51.722950 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:20:51.844632 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:20:51.966755 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:20:52.087185 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:20:52.295929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:52.606898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21746): Launched 16:20:52.878604 run iperf3-srv_10.42.42.10(pid=21747): Launched 16:20:52.996103 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:20:53.203129 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:53.514367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21748): Launched 16:20:53.786711 run iperf3-srv_10.42.42.10(pid=21749): Launched 16:20:53.903995 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:20:54.110450 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:54.421369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21750): Launched 16:20:54.688819 run iperf3-srv_10.42.42.10(pid=21751): Launched 16:20:54.804415 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:20:55.010591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:55.320026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21752): Launched 16:20:55.589619 run iperf3-srv_10.42.42.10(pid=21753): Launched 16:20:55.704365 tst iperf3m4.py:8: start network... 16:20:55.910421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:56.385483 run create_hlr_db(pid=21754): Launched 16:20:56.510699 bus /gobi_6: Setting Powered False 16:20:57.571476 run create_hlr_db(pid=21754): Terminated: ok {rc=0} 16:20:58.021366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21756): Launched 16:20:58.352860 run osmo-hlr_10.42.42.2(pid=21757): Launched 16:20:58.471635 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:59.005601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21759): Launched 16:20:59.312344 run osmo-stp_10.42.42.5(pid=21760): Launched 16:20:59.429497 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:59.960314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21762): Launched 16:21:00.078963 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:00.341487 run patchelf(pid=21763): Launched 16:21:00.514628 run osmo-stp_10.42.42.5(pid=21760): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21760)] 16:21:00.644406 run osmo-stp_10.42.42.5(pid=21760): stdout: | (launched: 2022-12-09_16:20:59.255706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:00.775916 run osmo-stp_10.42.42.5(pid=21760): stderr: | [0;m[38;5;43m20221209162059427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162059427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162059428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162059428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162059429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162059429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162059429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:00.908569 run osmo-stp_10.42.42.5(pid=21760): stdout: | (launched: 2022-12-09_16:20:59.255706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:01.035886 run osmo-stp_10.42.42.5(pid=21760): stderr: | [0;m[38;5;43m20221209162059427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162059427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162059428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162059428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162059429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162059429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162059429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:01.234256 run patchelf(pid=21763): Terminating (SIGINT) 16:21:01.414989 run patchelf(pid=21763): Terminated: ok {rc=0} 16:21:01.542427 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21760): Process ended prematurely: osmo-stp_10.42.42.5(pid=21760) [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21760)] [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 16:21:01.552910 tst iperf3m4.py:8: Test FAILED (10.6 sec) 16:21:01.582636 run osmo-hlr_10.42.42.2(pid=21757): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21757)] 16:21:01.632928 run osmo-hlr_10.42.42.2(pid=21757): stdout: | (launched: 2022-12-09_16:20:58.292392) 16:21:01.684572 run osmo-hlr_10.42.42.2(pid=21757): stderr: | [0;m[1;31m20221209162058474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162058474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162058474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162058474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162058474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162058474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162058487 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162058497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162058497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162058497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:01.736774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21746): Terminating (SIGTERM) 16:21:01.778637 run iperf3-srv_10.42.42.10(pid=21747): Terminating (SIGTERM) 16:21:01.819792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21748): Terminating (SIGTERM) 16:21:01.862948 run iperf3-srv_10.42.42.10(pid=21749): Terminating (SIGTERM) 16:21:01.906244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21750): Terminating (SIGTERM) 16:21:01.948206 run iperf3-srv_10.42.42.10(pid=21751): Terminating (SIGTERM) 16:21:01.989566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21752): Terminating (SIGTERM) 16:21:02.031027 run iperf3-srv_10.42.42.10(pid=21753): Terminating (SIGTERM) 16:21:02.072421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21756): Terminating (SIGTERM) 16:21:02.114707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21759): Terminating (SIGTERM) 16:21:02.157991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21762): Terminating (SIGTERM) 16:21:02.199928 --- ParallelTerminationStrategy: PID 21746 died... 16:21:02.219697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21746): Terminated: ok {rc=0} 16:21:02.266433 --- ParallelTerminationStrategy: PID 21747 died... 16:21:02.285956 run iperf3-srv_10.42.42.10(pid=21747): Terminated {rc=256} 16:21:02.330139 --- ParallelTerminationStrategy: PID 21748 died... 16:21:02.349024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21748): Terminated: ok {rc=0} 16:21:02.392845 --- ParallelTerminationStrategy: PID 21749 died... 16:21:02.411796 run iperf3-srv_10.42.42.10(pid=21749): Terminated {rc=256} 16:21:02.455588 --- ParallelTerminationStrategy: PID 21750 died... 16:21:02.474297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21750): Terminated: ok {rc=0} 16:21:02.517885 --- ParallelTerminationStrategy: PID 21751 died... 16:21:02.536520 run iperf3-srv_10.42.42.10(pid=21751): Terminated {rc=256} 16:21:02.580247 --- ParallelTerminationStrategy: PID 21752 died... 16:21:02.599018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21752): Terminated: ok {rc=0} 16:21:02.642564 --- ParallelTerminationStrategy: PID 21753 died... 16:21:02.661167 run iperf3-srv_10.42.42.10(pid=21753): Terminated {rc=256} 16:21:02.704846 --- ParallelTerminationStrategy: PID 21756 died... 16:21:02.724012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21756): Terminated: ok {rc=0} 16:21:02.768033 --- ParallelTerminationStrategy: PID 21759 died... 16:21:02.786716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21759): Terminated: ok {rc=0} 16:21:02.831504 --- ParallelTerminationStrategy: PID 21762 died... 16:21:02.850335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21762): Terminated: ok {rc=0} 16:21:02.936146 bus /gobi_4: Setting Powered False 16:21:04.036603 bus /gobi_4: Setting Powered False 16:21:05.153122 bus /gobi_1: Setting Powered False 16:21:06.254930 bus /gobi_1: Setting Powered False 16:21:07.373502 bus /gobi_0: Setting Powered False 16:21:08.472423 bus /gobi_0: Setting Powered False 16:21:09.587975 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 16:21:10.690906 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:10.703109 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:21:10.755892 tst ping.py: using LAC 22247 16:21:10.875564 tst ping.py: using RAC 62 16:21:10.995907 tst ping.py: using CellId 22247 16:21:11.114418 tst ping.py: using BVCI 22248 16:21:11.222926 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:11.234780 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:11.246094 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:11.257342 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:11.268520 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:11.279783 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:11.291064 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:11.302238 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:21:11.417942 tst ping.py:19: start network... 16:21:11.619484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:12.084533 run create_hlr_db(pid=21764): Launched 16:21:12.209919 bus /gobi_6: Setting Powered False 16:21:13.269985 run create_hlr_db(pid=21764): Terminated: ok {rc=0} 16:21:13.709396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21766): Launched 16:21:14.030070 run osmo-hlr_10.42.42.2(pid=21767): Launched 16:21:14.155174 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:14.712008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21769): Launched 16:21:15.036282 run osmo-stp_10.42.42.5(pid=21770): Launched 16:21:15.160830 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:15.716601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21772): Launched 16:21:15.843753 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:16.125030 run patchelf(pid=21773): Launched 16:21:16.312493 run osmo-stp_10.42.42.5(pid=21770): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21770)] 16:21:16.445674 run osmo-stp_10.42.42.5(pid=21770): stdout: | (launched: 2022-12-09_16:21:14.976880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:16.580044 run osmo-stp_10.42.42.5(pid=21770): stderr: | [0;m[38;5;43m20221209162115170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162115170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162115170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162115171 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162115173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162115173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162115173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:16.713689 run osmo-stp_10.42.42.5(pid=21770): stdout: | (launched: 2022-12-09_16:21:14.976880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:16.841324 run osmo-stp_10.42.42.5(pid=21770): stderr: | [0;m[38;5;43m20221209162115170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162115170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162115170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162115171 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162115173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162115173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162115173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:16.993182 run patchelf(pid=21773): Terminating (SIGINT) 16:21:17.166416 run patchelf(pid=21773): Terminated: ok {rc=0} 16:21:17.288305 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21770): Process ended prematurely: osmo-stp_10.42.42.5(pid=21770) [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21770)] [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 16:21:17.297670 tst ping.py:22: Test FAILED (6.6 sec) 16:21:17.324923 run osmo-hlr_10.42.42.2(pid=21767): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21767)] 16:21:17.373357 run osmo-hlr_10.42.42.2(pid=21767): stdout: | (launched: 2022-12-09_16:21:13.971130) 16:21:17.423009 run osmo-hlr_10.42.42.2(pid=21767): stderr: | [0;m[1;31m20221209162114172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162114172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162114172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162114172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162114172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162114172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162114183 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162114191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162114192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162114192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:17.473372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21766): Terminating (SIGTERM) 16:21:17.513919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21769): Terminating (SIGTERM) 16:21:17.554600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21772): Terminating (SIGTERM) 16:21:17.594862 --- ParallelTerminationStrategy: PID 21766 died... 16:21:17.614058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21766): Terminated: ok {rc=0} 16:21:17.658260 --- ParallelTerminationStrategy: PID 21769 died... 16:21:17.677210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21769): Terminated: ok {rc=0} 16:21:17.721243 --- ParallelTerminationStrategy: PID 21772 died... 16:21:17.740113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21772): Terminated: ok {rc=0} 16:21:17.824452 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 16:21:18.909273 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:18.921608 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:21:18.975273 tst ping_idle_ping.py: using LAC 22248 16:21:19.095236 tst ping_idle_ping.py: using RAC 63 16:21:19.214991 tst ping_idle_ping.py: using CellId 22248 16:21:19.334374 tst ping_idle_ping.py: using BVCI 22249 16:21:19.445599 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:19.457315 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:19.468704 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:19.480229 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:19.491609 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:19.503062 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:19.514581 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:21:19.526076 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:21:19.643978 tst ping_idle_ping.py:24: start network... 16:21:19.847059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:20.315492 run create_hlr_db(pid=21774): Launched 16:21:20.440288 bus /gobi_6: Setting Powered False 16:21:21.501616 run create_hlr_db(pid=21774): Terminated: ok {rc=0} 16:21:21.948228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21776): Launched 16:21:22.273252 run osmo-hlr_10.42.42.2(pid=21777): Launched 16:21:22.399151 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:22.958513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21779): Launched 16:21:23.283165 run osmo-stp_10.42.42.5(pid=21780): Launched 16:21:23.408808 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:23.967576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21782): Launched 16:21:24.092506 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:24.365465 run patchelf(pid=21783): Launched 16:21:24.547784 run osmo-stp_10.42.42.5(pid=21780): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21780)] 16:21:24.684264 run osmo-stp_10.42.42.5(pid=21780): stdout: | (launched: 2022-12-09_16:21:23.223912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:24.822798 run osmo-stp_10.42.42.5(pid=21780): stderr: | [0;m[38;5;43m20221209162123415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162123415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162123415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162123416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162123418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162123418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162123418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:24.961366 run osmo-stp_10.42.42.5(pid=21780): stdout: | (launched: 2022-12-09_16:21:23.223912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:25.093388 run osmo-stp_10.42.42.5(pid=21780): stderr: | [0;m[38;5;43m20221209162123415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162123415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162123415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162123416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162123418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162123418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162123418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:25.250175 run patchelf(pid=21783): Terminating (SIGINT) 16:21:25.430765 run patchelf(pid=21783): Terminated: ok {rc=0} 16:21:25.561245 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21780): Process ended prematurely: osmo-stp_10.42.42.5(pid=21780) [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21780)] [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 16:21:25.570998 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:21:25.599781 run osmo-hlr_10.42.42.2(pid=21777): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21777)] 16:21:25.650076 run osmo-hlr_10.42.42.2(pid=21777): stdout: | (launched: 2022-12-09_16:21:22.213890) 16:21:25.702112 run osmo-hlr_10.42.42.2(pid=21777): stderr: | [0;m[1;31m20221209162122413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162122414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162122414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162122414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162122414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162122414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162122426 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162122435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162122435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162122435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:25.754727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21776): Terminating (SIGTERM) 16:21:25.797156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21779): Terminating (SIGTERM) 16:21:25.839598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21782): Terminating (SIGTERM) 16:21:25.882009 --- ParallelTerminationStrategy: PID 21776 died... 16:21:25.902149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21776): Terminated: ok {rc=0} 16:21:25.949450 --- ParallelTerminationStrategy: PID 21779 died... 16:21:25.969265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21779): Terminated: ok {rc=0} 16:21:26.016107 --- ParallelTerminationStrategy: PID 21782 died... 16:21:26.035853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21782): Terminated: ok {rc=0} 16:21:26.125425 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:21:27.436454 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:21:27.443202 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:21:27.476025 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:21:27.510925 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:21:27.563960 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:21:27.596630 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:21:27.631625 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:21:28.198042 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:21:28.203391 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:28.214832 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:21:28.285672 tst switch_tch_pdch.py: using LAC 22249 16:21:28.403760 tst switch_tch_pdch.py: using RAC 64 16:21:28.521369 tst switch_tch_pdch.py: using CellId 22249 16:21:28.637928 tst switch_tch_pdch.py: using BVCI 22250 16:21:28.746426 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:28.757750 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:28.768880 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:28.780297 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:28.791688 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:28.802969 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:28.814442 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:21:28.825899 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:21:28.946328 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:21:29.064555 tst switch_tch_pdch.py:51: start network... 16:21:29.267750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:29.732342 run create_hlr_db(pid=21787): Launched 16:21:29.855320 bus /gobi_6: Setting Powered False 16:21:30.938339 run create_hlr_db(pid=21787): Terminated: ok {rc=0} 16:21:31.398992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21789): Launched 16:21:31.745773 run osmo-hlr_10.42.42.2(pid=21790): Launched 16:21:31.925568 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:32.550953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21792): Launched 16:21:32.874918 run osmo-stp_10.42.42.5(pid=21793): Launched 16:21:32.997934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:33.554710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21795): Launched 16:21:33.678195 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:33.951005 run patchelf(pid=21796): Launched 16:21:34.131682 run osmo-stp_10.42.42.5(pid=21793): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21793)] 16:21:34.268156 run osmo-stp_10.42.42.5(pid=21793): stdout: | (launched: 2022-12-09_16:21:32.815844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:34.406959 run osmo-stp_10.42.42.5(pid=21793): stderr: | [0;m[38;5;43m20221209162133007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162133008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162133008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162133008 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162133009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162133009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162133009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:34.546727 run osmo-stp_10.42.42.5(pid=21793): stdout: | (launched: 2022-12-09_16:21:32.815844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:34.679191 run osmo-stp_10.42.42.5(pid=21793): stderr: | [0;m[38;5;43m20221209162133007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162133008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162133008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162133008 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162133009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162133009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162133009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:34.835935 run patchelf(pid=21796): Terminating (SIGINT) 16:21:35.015416 run patchelf(pid=21796): Terminated: ok {rc=0} 16:21:35.145118 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21793): Process ended prematurely: osmo-stp_10.42.42.5(pid=21793) [trial-2361↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21793)] [trial-2361↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:21:35.154981 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 16:21:35.183345 run osmo-hlr_10.42.42.2(pid=21790): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21790)] 16:21:35.234028 run osmo-hlr_10.42.42.2(pid=21790): stdout: | (launched: 2022-12-09_16:21:31.683016) 16:21:35.286362 run osmo-hlr_10.42.42.2(pid=21790): stderr: | [0;m[1;31m20221209162132071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162132071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162132072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162132072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162132072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162132072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162132096 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162132111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162132111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162132112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:35.339334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21789): Terminating (SIGTERM) 16:21:35.381780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21792): Terminating (SIGTERM) 16:21:35.424031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21795): Terminating (SIGTERM) 16:21:35.466730 --- ParallelTerminationStrategy: PID 21789 died... 16:21:35.486701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21789): Terminated: ok {rc=0} 16:21:35.533818 --- ParallelTerminationStrategy: PID 21792 died... 16:21:35.553563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21792): Terminated: ok {rc=0} 16:21:35.600236 --- ParallelTerminationStrategy: PID 21795 died... 16:21:35.619883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21795): Terminated: ok {rc=0} 16:21:35.708327 bus /gobi_0: Setting Powered False 16:21:36.807629 bus /gobi_0: Setting Powered False 16:21:37.924352 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:21:39.175981 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:21:39.183418 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:21:39.217583 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:21:39.253495 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:21:39.310102 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:21:39.344161 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:21:39.379657 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:21:39.934968 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:21:39.940423 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:39.951948 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:21:40.024274 tst switch_tch_pdch.py: using LAC 22250 16:21:40.150999 tst switch_tch_pdch.py: using RAC 65 16:21:40.276294 tst switch_tch_pdch.py: using CellId 22250 16:21:40.395577 tst switch_tch_pdch.py: using BVCI 22251 16:21:40.504099 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:40.515513 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:40.527072 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:40.538613 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:40.549888 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:40.561440 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:40.572635 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:21:40.583915 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:21:40.701529 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:21:40.821592 tst switch_tch_pdch.py:51: start network... 16:21:41.039241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:41.509472 run create_hlr_db(pid=21802): Launched 16:21:41.637196 bus /gobi_6: Setting Powered False 16:21:42.697388 run create_hlr_db(pid=21802): Terminated: ok {rc=0} 16:21:43.111082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21804): Launched 16:21:43.434783 run osmo-hlr_10.42.42.2(pid=21805): Launched 16:21:43.559115 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:44.088551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21807): Launched 16:21:44.413058 run osmo-stp_10.42.42.5(pid=21808): Launched 16:21:44.537457 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:45.065788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21810): Launched 16:21:45.186981 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:45.442384 run patchelf(pid=21811): Launched 16:21:45.609767 run osmo-stp_10.42.42.5(pid=21808): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21808)] 16:21:45.736583 run osmo-stp_10.42.42.5(pid=21808): stdout: | (launched: 2022-12-09_16:21:44.353644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:45.891222 run osmo-stp_10.42.42.5(pid=21808): stderr: | [0;m[38;5;43m20221209162144546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162144546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162144546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162144547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162144547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162144547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162144547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:46.023609 run osmo-stp_10.42.42.5(pid=21808): stdout: | (launched: 2022-12-09_16:21:44.353644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:46.149983 run osmo-stp_10.42.42.5(pid=21808): stderr: | [0;m[38;5;43m20221209162144546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162144546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162144546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162144547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162144547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162144547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162144547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:46.299158 run patchelf(pid=21811): Terminating (SIGINT) 16:21:46.470968 run patchelf(pid=21811): Terminated: ok {rc=0} 16:21:46.595480 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21808): Process ended prematurely: osmo-stp_10.42.42.5(pid=21808) [trial-2361↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21808)] [trial-2361↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:21:46.605347 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 16:21:46.633129 run osmo-hlr_10.42.42.2(pid=21805): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21805)] 16:21:46.682281 run osmo-hlr_10.42.42.2(pid=21805): stdout: | (launched: 2022-12-09_16:21:43.375641) 16:21:46.733160 run osmo-hlr_10.42.42.2(pid=21805): stderr: | [0;m[1;31m20221209162143575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162143575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162143575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162143575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162143575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162143575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162143587 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162143596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162143596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162143596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:46.784433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21804): Terminating (SIGTERM) 16:21:46.826650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21807): Terminating (SIGTERM) 16:21:46.869697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21810): Terminating (SIGTERM) 16:21:46.912858 --- ParallelTerminationStrategy: PID 21804 died... 16:21:46.932529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21804): Terminated: ok {rc=0} 16:21:46.978865 --- ParallelTerminationStrategy: PID 21807 died... 16:21:46.998114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21807): Terminated: ok {rc=0} 16:21:47.042755 --- ParallelTerminationStrategy: PID 21810 died... 16:21:47.061852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21810): Terminated: ok {rc=0} 16:21:47.147318 bus /gobi_0: Setting Powered False 16:21:48.246253 bus /gobi_0: Setting Powered False 16:21:49.360885 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_sms:trx-lms --------------------------------------------------------------------- 16:21:50.609898 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:21:50.613930 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 16:21:50.647497 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 16:21:50.654452 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 16:21:50.707867 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 16:21:50.743436 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 16:21:50.750606 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 16:21:51.283915 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 16:21:51.289719 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 16:21:51.300477 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 16:21:51.351857 tst mo_mt_sms.py: using LAC 22251 16:21:51.470584 tst mo_mt_sms.py: using RAC 66 16:21:51.588327 tst mo_mt_sms.py: using CellId 22251 16:21:51.704455 tst mo_mt_sms.py: using BVCI 22252 16:21:51.812247 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 16:21:51.930082 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 16:21:52.044772 tst mo_mt_sms.py:9: start nitb and bts... 16:21:52.248332 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:21:52.861194 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21815): Launched 16:21:53.162584 run osmo-nitb_10.42.42.2(pid=21816): Launched 16:21:53.331146 run osmo-nitb_10.42.42.2(pid=21816): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21816)] 16:21:53.466187 run osmo-nitb_10.42.42.2(pid=21816): stdout: | (launched: 2022-12-09_16:21:53.105999) 16:21:53.602769 run osmo-nitb_10.42.42.2(pid=21816): stderr: | (launched: 2022-12-09_16:21:53.150658) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:21:53.738975 run osmo-nitb_10.42.42.2(pid=21816): stdout: | (launched: 2022-12-09_16:21:53.105999) 16:21:53.869512 run osmo-nitb_10.42.42.2(pid=21816): stderr: | (launched: 2022-12-09_16:21:53.150658) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21816): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21816) [trial-2361↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21816)] 16:21:54.278149 tst osmo-nitb_10.42.42.2(pid=21816): stdout: | (launched: 2022-12-09_16:21:53.105999) 16:21:54.399937 tst osmo-nitb_10.42.42.2(pid=21816): stderr: | (launched: 2022-12-09_16:21:53.150658) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:21:54.542999 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=21816): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21816) [trial-2361↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21816)] [trial-2361↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 16:21:54.551587 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 16:21:54.558392 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21815): Terminating (SIGTERM) 16:21:54.766777 --- ParallelTerminationStrategy: PID 21815 died... 16:21:54.787556 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21815): Terminated: ok {rc=0} 16:21:54.873335 bus /sierra_3: Setting Powered False 16:21:55.973610 bus /sierra_3: Setting Powered False 16:21:57.090511 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 sms:trx-lms --------------------------------------------------------------------- 16:21:58.286885 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:21:58.291051 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 16:21:58.324256 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 16:21:58.351162 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 16:21:58.404213 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 16:21:58.437090 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 16:21:58.463544 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 16:21:59.012480 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 16:21:59.018729 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:21:59.029904 tst sms:trx-lms: Using 1 x bts (candidates: 1) 16:21:59.077053 tst mo_mt_sms.py: using LAC 22252 16:21:59.192098 tst mo_mt_sms.py: using RAC 67 16:21:59.307179 tst mo_mt_sms.py: using CellId 22252 16:21:59.422448 tst mo_mt_sms.py: using BVCI 22253 16:21:59.531968 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:21:59.542618 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:21:59.553082 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:21:59.563513 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:21:59.574068 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:21:59.584531 tst sms:trx-lms: Using 1 x modem (candidates: 2) 16:21:59.700313 tst sms:trx-lms: Using 1 x modem (candidates: 2) 16:21:59.818606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:00.285221 run create_hlr_db(pid=21820): Launched 16:22:00.408516 bus /sierra_2: Setting Powered False 16:22:01.470172 run create_hlr_db(pid=21820): Terminated: ok {rc=0} 16:22:01.904022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21822): Launched 16:22:02.245419 run osmo-hlr_10.42.42.2(pid=21823): Launched 16:22:02.363645 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:02.881746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21825): Launched 16:22:03.182198 run osmo-stp_10.42.42.5(pid=21826): Launched 16:22:03.298282 run osmo-msc_10.42.42.6: Starting osmo-msc 16:22:03.860932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21828): Launched 16:22:04.163474 run osmo-msc_10.42.42.6(pid=21829): Launched 16:22:04.332611 run osmo-stp_10.42.42.5(pid=21826): ERR: Terminated: ERROR {rc=1} [trial-2361↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21826)] 16:22:04.461576 run osmo-stp_10.42.42.5(pid=21826): stdout: | (launched: 2022-12-09_16:22:03.126615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:04.589133 run osmo-stp_10.42.42.5(pid=21826): stderr: | [0;m[38;5;43m20221209162203295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162203296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162203296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162203296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162203298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162203299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162203299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:04.714685 run osmo-stp_10.42.42.5(pid=21826): stdout: | (launched: 2022-12-09_16:22:03.126615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:04.835785 run osmo-stp_10.42.42.5(pid=21826): stderr: | [0;m[38;5;43m20221209162203295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162203296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162203296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162203296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162203298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162203299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162203299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:04.979674 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=21826): Process ended prematurely: osmo-stp_10.42.42.5(pid=21826) [trial-2361↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21826)] [trial-2361↪sms:trx-lms↪mo_mt_sms.py:16] 16:22:04.988048 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 16:22:05.013930 run osmo-hlr_10.42.42.2(pid=21823): ERR: Terminated: ERROR {rc=237} [trial-2361↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21823)] 16:22:05.061340 run osmo-hlr_10.42.42.2(pid=21823): stdout: | (launched: 2022-12-09_16:22:02.185438) 16:22:05.110659 run osmo-hlr_10.42.42.2(pid=21823): stderr: | [0;m[1;31m20221209162202366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162202366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162202366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162202366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162202366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162202366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162202386 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162202396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162202396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162202396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:05.179377 run osmo-msc_10.42.42.6(pid=21829): ERR: Terminated: ERROR {rc=2} [trial-2361↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21829)] 16:22:05.226882 run osmo-msc_10.42.42.6(pid=21829): stdout: | (launched: 2022-12-09_16:22:04.107290) 16:22:05.276060 run osmo-msc_10.42.42.6(pid=21829): stderr: | [0;m[38;5;43m20221209162204380 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162204380 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba5788bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162204380 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162204380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162204380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162204380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162204383 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162204384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162204384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162204384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:22:05.325638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21822): Terminating (SIGTERM) 16:22:05.365799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21825): Terminating (SIGTERM) 16:22:05.405514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21828): Terminating (SIGTERM) 16:22:05.445385 --- ParallelTerminationStrategy: PID 21822 died... 16:22:05.464377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21822): Terminated: ok {rc=0} 16:22:05.508194 --- ParallelTerminationStrategy: PID 21825 died... 16:22:05.526775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21825): Terminated: ok {rc=0} 16:22:05.570292 --- ParallelTerminationStrategy: PID 21828 died... 16:22:05.588530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21828): Terminated: ok {rc=0} 16:22:05.674690 bus /sierra_3: Setting Powered False 16:22:06.773600 bus /sierra_3: Setting Powered False 16:22:07.888043 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_ussd:trx-lms --------------------------------------------------------------------- 16:22:09.117818 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:22:09.121642 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 16:22:09.154489 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 16:22:09.161305 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 16:22:09.196771 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 16:22:09.230018 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 16:22:09.236705 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 16:22:09.755688 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2361 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 16:22:09.760781 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 16:22:09.771667 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 16:22:09.819459 tst assert_extension.py: using LAC 22253 16:22:09.938361 tst assert_extension.py: using RAC 68 16:22:10.057488 tst assert_extension.py: using CellId 22253 16:22:10.177041 tst assert_extension.py: using BVCI 22254 16:22:10.284812 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 16:22:10.403253 tst assert_extension.py:10: start nitb and bts... 16:22:10.636900 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:22:11.272808 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21834): Launched 16:22:11.584733 run osmo-nitb_10.42.42.2(pid=21835): Launched 16:22:11.757162 run osmo-nitb_10.42.42.2(pid=21835): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21835)] 16:22:11.897152 run osmo-nitb_10.42.42.2(pid=21835): stdout: | (launched: 2022-12-09_16:22:11.527485) 16:22:12.038550 run osmo-nitb_10.42.42.2(pid=21835): stderr: | (launched: 2022-12-09_16:22:11.574181) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:22:12.180104 run osmo-nitb_10.42.42.2(pid=21835): stdout: | (launched: 2022-12-09_16:22:11.527485) 16:22:12.315502 run osmo-nitb_10.42.42.2(pid=21835): stderr: | (launched: 2022-12-09_16:22:11.574181) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21835): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21835) [trial-2361↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21835)] 16:22:12.702052 tst osmo-nitb_10.42.42.2(pid=21835): stdout: | (launched: 2022-12-09_16:22:11.527485) 16:22:12.828896 tst osmo-nitb_10.42.42.2(pid=21835): stderr: | (launched: 2022-12-09_16:22:11.574181) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:22:12.978165 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=21835): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21835) [trial-2361↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21835)] [trial-2361↪nitb_ussd:trx-lms↪assert_extension.py:12] 16:22:12.986932 tst assert_extension.py:12: Test FAILED (3.2 sec) 16:22:12.993906 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21834): Terminating (SIGTERM) 16:22:13.206143 --- ParallelTerminationStrategy: PID 21834 died... 16:22:13.226799 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21834): Terminated: ok {rc=0} 16:22:13.309034 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 ussd:trx-lms --------------------------------------------------------------------- 16:22:14.480375 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:22:14.485283 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 16:22:14.520212 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 16:22:14.547597 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 16:22:14.584991 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 16:22:14.619601 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 16:22:14.646780 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 16:22:15.173181 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2361 ussd:trx-lms assert_extension.py ---------------------------------------------- 16:22:15.178224 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:22:15.189098 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 16:22:15.237201 tst assert_extension.py: using LAC 22254 16:22:15.360588 tst assert_extension.py: using RAC 69 16:22:15.483076 tst assert_extension.py: using CellId 22254 16:22:15.605207 tst assert_extension.py: using BVCI 22255 16:22:15.717501 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:22:15.728365 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:22:15.739247 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:22:15.750324 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:22:15.761440 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:22:15.772331 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 16:22:15.915428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:16.392723 run create_hlr_db(pid=21840): Launched 16:22:16.547958 bus /sierra_2: Setting Powered False 16:22:17.606085 run create_hlr_db(pid=21840): Terminated: ok {rc=0} 16:22:18.037789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21842): Launched 16:22:18.350213 run osmo-hlr_10.42.42.2(pid=21843): Launched 16:22:18.469461 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:19.011487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21845): Launched 16:22:19.323519 run osmo-stp_10.42.42.5(pid=21846): Launched 16:22:19.443233 run osmo-msc_10.42.42.6: Starting osmo-msc 16:22:20.006734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21848): Launched 16:22:20.319534 run osmo-msc_10.42.42.6(pid=21849): Launched 16:22:20.494521 run osmo-stp_10.42.42.5(pid=21846): ERR: Terminated: ERROR {rc=1} [trial-2361↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21846)] 16:22:20.627374 run osmo-stp_10.42.42.5(pid=21846): stdout: | (launched: 2022-12-09_16:22:19.266766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:20.759362 run osmo-stp_10.42.42.5(pid=21846): stderr: | [0;m[38;5;43m20221209162219457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162219458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162219458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162219458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162219459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162219459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162219459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:20.891420 run osmo-stp_10.42.42.5(pid=21846): stdout: | (launched: 2022-12-09_16:22:19.266766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:21.016235 run osmo-stp_10.42.42.5(pid=21846): stderr: | [0;m[38;5;43m20221209162219457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162219458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162219458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162219458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162219459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162219459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162219459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:21.165831 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=21846): Process ended prematurely: osmo-stp_10.42.42.5(pid=21846) [trial-2361↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21846)] [trial-2361↪ussd:trx-lms↪assert_extension.py:17] 16:22:21.174527 tst assert_extension.py:17: Test FAILED (6.0 sec) 16:22:21.201738 run osmo-hlr_10.42.42.2(pid=21843): ERR: Terminated: ERROR {rc=237} [trial-2361↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21843)] 16:22:21.251162 run osmo-hlr_10.42.42.2(pid=21843): stdout: | (launched: 2022-12-09_16:22:18.293029) 16:22:21.302276 run osmo-hlr_10.42.42.2(pid=21843): stderr: | [0;m[1;31m20221209162218489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162218489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162218489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162218489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162218489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162218489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162218502 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162218512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162218513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162218513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:21.374018 run osmo-msc_10.42.42.6(pid=21849): ERR: Terminated: ERROR {rc=2} [trial-2361↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21849)] 16:22:21.423681 run osmo-msc_10.42.42.6(pid=21849): stdout: | (launched: 2022-12-09_16:22:20.262100) 16:22:21.474904 run osmo-msc_10.42.42.6(pid=21849): stderr: | [0;m[38;5;43m20221209162220582 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162220582 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0c9f0a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162220582 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162220582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162220582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162220583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162220584 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162220585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162220585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162220585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:22:21.527025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21842): Terminating (SIGTERM) 16:22:21.568427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21845): Terminating (SIGTERM) 16:22:21.610352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21848): Terminating (SIGTERM) 16:22:21.651995 --- ParallelTerminationStrategy: PID 21842 died... 16:22:21.671734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21842): Terminated: ok {rc=0} 16:22:21.718071 --- ParallelTerminationStrategy: PID 21845 died... 16:22:21.737230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21845): Terminated: ok {rc=0} 16:22:21.782962 --- ParallelTerminationStrategy: PID 21848 died... 16:22:21.802103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21848): Terminated: ok {rc=0} 16:22:21.888687 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:22:23.102726 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:22:23.110744 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:22:23.144320 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:22:23.171078 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:22:23.222402 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:22:23.255020 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:22:23.281484 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:22:23.832031 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:22:23.880409 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:23.891796 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:22:23.975209 tst mo_mt_call.py: using LAC 22255 16:22:24.095811 tst mo_mt_call.py: using RAC 70 16:22:24.212930 tst mo_mt_call.py: using CellId 22255 16:22:24.336244 tst mo_mt_call.py: using BVCI 22256 16:22:24.444397 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:24.455465 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:24.466289 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:24.477432 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:24.488512 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:24.499511 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:22:24.617374 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:22:24.734566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:25.193701 run create_hlr_db(pid=21854): Launched 16:22:25.314917 bus /sierra_2: Setting Powered False 16:22:26.373565 run create_hlr_db(pid=21854): Terminated: ok {rc=0} 16:22:26.808716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21856): Launched 16:22:27.127776 run osmo-hlr_10.42.42.2(pid=21857): Launched 16:22:27.249573 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:27.796416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21859): Launched 16:22:28.113696 run osmo-stp_10.42.42.5(pid=21860): Launched 16:22:28.234477 run osmo-msc_10.42.42.6: Starting osmo-msc 16:22:28.808736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21862): Launched 16:22:29.127529 run osmo-msc_10.42.42.6(pid=21863): Launched 16:22:29.305363 run osmo-stp_10.42.42.5(pid=21860): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21860)] 16:22:29.439344 run osmo-stp_10.42.42.5(pid=21860): stdout: | (launched: 2022-12-09_16:22:28.056187) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:29.574238 run osmo-stp_10.42.42.5(pid=21860): stderr: | [0;m[38;5;43m20221209162228247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162228247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162228248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162228248 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162228249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162228249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162228249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:29.707879 run osmo-stp_10.42.42.5(pid=21860): stdout: | (launched: 2022-12-09_16:22:28.056187) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:29.833977 run osmo-stp_10.42.42.5(pid=21860): stderr: | [0;m[38;5;43m20221209162228247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162228247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162228248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162228248 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162228249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162228249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162228249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:29.985058 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21860): Process ended prematurely: osmo-stp_10.42.42.5(pid=21860) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21860)] [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:22:29.994454 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:22:30.022333 run osmo-hlr_10.42.42.2(pid=21857): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21857)] 16:22:30.071789 run osmo-hlr_10.42.42.2(pid=21857): stdout: | (launched: 2022-12-09_16:22:27.069990) 16:22:30.123077 run osmo-hlr_10.42.42.2(pid=21857): stderr: | [0;m[1;31m20221209162227267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162227267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162227267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162227267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162227267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162227267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162227280 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162227288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162227289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162227289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:30.194208 run osmo-msc_10.42.42.6(pid=21863): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21863)] 16:22:30.243961 run osmo-msc_10.42.42.6(pid=21863): stdout: | (launched: 2022-12-09_16:22:29.069662) 16:22:30.295067 run osmo-msc_10.42.42.6(pid=21863): stderr: | [0;m[38;5;43m20221209162229390 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162229390 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f83db6f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162229390 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162229390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162229390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162229390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162229392 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162229392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162229392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162229393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:22:30.346844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21856): Terminating (SIGTERM) 16:22:30.388356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21859): Terminating (SIGTERM) 16:22:30.429733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21862): Terminating (SIGTERM) 16:22:30.471418 --- ParallelTerminationStrategy: PID 21856 died... 16:22:30.491051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21856): Terminated: ok {rc=0} 16:22:30.537296 --- ParallelTerminationStrategy: PID 21859 died... 16:22:30.556421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21859): Terminated: ok {rc=0} 16:22:30.602192 --- ParallelTerminationStrategy: PID 21862 died... 16:22:30.621422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21862): Terminated: ok {rc=0} 16:22:30.708594 bus /sierra_3: Setting Powered False 16:22:31.815504 bus /sierra_3: Setting Powered False 16:22:32.946803 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:22:34.095461 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:34.107501 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:22:34.178884 tst mo_mt_call_osmux.py: using LAC 22256 16:22:34.303500 tst mo_mt_call_osmux.py: using RAC 71 16:22:34.427437 tst mo_mt_call_osmux.py: using CellId 22256 16:22:34.552181 tst mo_mt_call_osmux.py: using BVCI 22257 16:22:34.668633 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:34.680128 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:34.691445 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:34.703044 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:34.714729 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:22:34.726566 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:22:34.843453 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:22:34.970894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:35.430672 run create_hlr_db(pid=21865): Launched 16:22:35.554203 bus /sierra_2: Setting Powered False 16:22:36.614728 run create_hlr_db(pid=21865): Terminated: ok {rc=0} 16:22:37.032831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21869): Launched 16:22:37.332025 run osmo-hlr_10.42.42.2(pid=21870): Launched 16:22:37.445236 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:37.972524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21872): Launched 16:22:38.270961 run osmo-stp_10.42.42.5(pid=21873): Launched 16:22:38.384115 run osmo-msc_10.42.42.6: Starting osmo-msc 16:22:38.920854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21875): Launched 16:22:39.219284 run osmo-msc_10.42.42.6(pid=21876): Launched 16:22:39.384537 run osmo-stp_10.42.42.5(pid=21873): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21873)] 16:22:39.509331 run osmo-stp_10.42.42.5(pid=21873): stdout: | (launched: 2022-12-09_16:22:38.216080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:39.634903 run osmo-stp_10.42.42.5(pid=21873): stderr: | [0;m[38;5;43m20221209162238386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162238386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162238386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162238387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162238387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162238387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162238387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:39.758521 run osmo-stp_10.42.42.5(pid=21873): stdout: | (launched: 2022-12-09_16:22:38.216080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:39.875949 run osmo-stp_10.42.42.5(pid=21873): stderr: | [0;m[38;5;43m20221209162238386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162238386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162238386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162238387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162238387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162238387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162238387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:40.016762 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21873): Process ended prematurely: osmo-stp_10.42.42.5(pid=21873) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21873)] [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:22:40.025460 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 16:22:40.051227 run osmo-hlr_10.42.42.2(pid=21870): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21870)] 16:22:40.098246 run osmo-hlr_10.42.42.2(pid=21870): stdout: | (launched: 2022-12-09_16:22:37.276924) 16:22:40.146685 run osmo-hlr_10.42.42.2(pid=21870): stderr: | [0;m[1;31m20221209162237451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162237451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162237451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162237452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162237452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162237452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162237464 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162237473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162237473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162237473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:40.214540 run osmo-msc_10.42.42.6(pid=21876): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21876)] 16:22:40.261150 run osmo-msc_10.42.42.6(pid=21876): stdout: | (launched: 2022-12-09_16:22:39.164648) 16:22:40.309360 run osmo-msc_10.42.42.6(pid=21876): stderr: | [0;m[38;5;43m20221209162239435 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162239435 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa8c4339c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162239435 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162239435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162239436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162239436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162239438 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162239438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162239438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162239438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:22:40.358109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21869): Terminating (SIGTERM) 16:22:40.396634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21872): Terminating (SIGTERM) 16:22:40.435589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21875): Terminating (SIGTERM) 16:22:40.474744 --- ParallelTerminationStrategy: PID 21869 died... 16:22:40.493443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21869): Terminated: ok {rc=0} 16:22:40.536355 --- ParallelTerminationStrategy: PID 21872 died... 16:22:40.554664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21872): Terminated: ok {rc=0} 16:22:40.597396 --- ParallelTerminationStrategy: PID 21875 died... 16:22:40.615517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21875): Terminated: ok {rc=0} 16:22:40.699300 bus /sierra_3: Setting Powered False 16:22:41.797862 bus /sierra_3: Setting Powered False 16:22:42.914137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:22:44.158373 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:22:44.164667 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:22:44.197325 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:22:44.223695 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:22:44.274986 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:22:44.307120 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:22:44.333267 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:22:44.885308 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:22:44.932320 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:44.943320 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:22:45.015458 tst mo_mt_call.py: using LAC 22257 16:22:45.131907 tst mo_mt_call.py: using RAC 72 16:22:45.245692 tst mo_mt_call.py: using CellId 22257 16:22:45.359788 tst mo_mt_call.py: using BVCI 22258 16:22:45.466008 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:45.476810 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:45.487618 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:45.498428 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:45.509295 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:45.519938 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:22:45.636494 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:22:45.752160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:46.262095 run create_hlr_db(pid=21881): Launched 16:22:46.419499 bus /sierra_2: Setting Powered False 16:22:47.478615 run create_hlr_db(pid=21881): Terminated: ok {rc=0} 16:22:47.913885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21883): Launched 16:22:48.233536 run osmo-hlr_10.42.42.2(pid=21884): Launched 16:22:48.355275 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:48.902330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21886): Launched 16:22:49.219365 run osmo-stp_10.42.42.5(pid=21887): Launched 16:22:49.340278 run osmo-msc_10.42.42.6: Starting osmo-msc 16:22:49.913544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21889): Launched 16:22:50.231414 run osmo-msc_10.42.42.6(pid=21890): Launched 16:22:50.409080 run osmo-stp_10.42.42.5(pid=21887): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21887)] 16:22:50.546046 run osmo-stp_10.42.42.5(pid=21887): stdout: | (launched: 2022-12-09_16:22:49.161924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:50.681623 run osmo-stp_10.42.42.5(pid=21887): stderr: | [0;m[38;5;43m20221209162249350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162249350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162249350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162249350 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162249351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162249351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162249351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:50.813367 run osmo-stp_10.42.42.5(pid=21887): stdout: | (launched: 2022-12-09_16:22:49.161924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:50.939044 run osmo-stp_10.42.42.5(pid=21887): stderr: | [0;m[38;5;43m20221209162249350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162249350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162249350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162249350 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162249351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162249351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162249351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:51.089781 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21887): Process ended prematurely: osmo-stp_10.42.42.5(pid=21887) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21887)] [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:22:51.099200 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:22:51.127017 run osmo-hlr_10.42.42.2(pid=21884): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21884)] 16:22:51.176683 run osmo-hlr_10.42.42.2(pid=21884): stdout: | (launched: 2022-12-09_16:22:48.175819) 16:22:51.227938 run osmo-hlr_10.42.42.2(pid=21884): stderr: | [0;m[1;31m20221209162248371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162248371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162248371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162248371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162248371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162248371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162248384 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162248392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162248393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162248393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:51.299416 run osmo-msc_10.42.42.6(pid=21890): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21890)] 16:22:51.349072 run osmo-msc_10.42.42.6(pid=21890): stdout: | (launched: 2022-12-09_16:22:50.174014) 16:22:51.400017 run osmo-msc_10.42.42.6(pid=21890): stderr: | [0;m[38;5;43m20221209162250494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162250494 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1d34f10c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162250494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162250494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162250494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162250495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162250496 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162250497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162250497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162250497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:22:51.451623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21883): Terminating (SIGTERM) 16:22:51.492836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21886): Terminating (SIGTERM) 16:22:51.534388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21889): Terminating (SIGTERM) 16:22:51.575977 --- ParallelTerminationStrategy: PID 21883 died... 16:22:51.595746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21883): Terminated: ok {rc=0} 16:22:51.641548 --- ParallelTerminationStrategy: PID 21886 died... 16:22:51.660585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21886): Terminated: ok {rc=0} 16:22:51.706326 --- ParallelTerminationStrategy: PID 21889 died... 16:22:51.725414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21889): Terminated: ok {rc=0} 16:22:51.811735 bus /sierra_3: Setting Powered False 16:22:52.911110 bus /sierra_3: Setting Powered False 16:22:54.025262 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:22:55.170350 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:55.182038 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:22:55.251227 tst mo_mt_call_osmux.py: using LAC 22258 16:22:55.366609 tst mo_mt_call_osmux.py: using RAC 73 16:22:55.483698 tst mo_mt_call_osmux.py: using CellId 22258 16:22:55.599223 tst mo_mt_call_osmux.py: using BVCI 22259 16:22:55.704786 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:55.715756 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:55.726489 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:55.737275 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:55.748048 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:22:55.758841 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:22:55.875784 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:22:55.996484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:56.488346 run create_hlr_db(pid=21892): Launched 16:22:56.610892 bus /sierra_2: Setting Powered False 16:22:57.673305 run create_hlr_db(pid=21892): Terminated: ok {rc=0} 16:22:58.114491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21894): Launched 16:22:58.431560 run osmo-hlr_10.42.42.2(pid=21895): Launched 16:22:58.553555 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:59.100209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21897): Launched 16:22:59.418111 run osmo-stp_10.42.42.5(pid=21898): Launched 16:22:59.539578 run osmo-msc_10.42.42.6: Starting osmo-msc 16:23:00.113225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21900): Launched 16:23:00.430682 run osmo-msc_10.42.42.6(pid=21901): Launched 16:23:00.608728 run osmo-stp_10.42.42.5(pid=21898): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21898)] 16:23:00.743194 run osmo-stp_10.42.42.5(pid=21898): stdout: | (launched: 2022-12-09_16:22:59.360646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:00.942391 run osmo-stp_10.42.42.5(pid=21898): stderr: | [0;m[38;5;43m20221209162259547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162259547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162259547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162259548 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162259548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162259548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162259548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:01.114726 run osmo-stp_10.42.42.5(pid=21898): stdout: | (launched: 2022-12-09_16:22:59.360646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:01.244766 run osmo-stp_10.42.42.5(pid=21898): stderr: | [0;m[38;5;43m20221209162259547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162259547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162259547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162259548 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162259548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162259548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162259548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:01.400859 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21898): Process ended prematurely: osmo-stp_10.42.42.5(pid=21898) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21898)] [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:23:01.411273 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:23:01.442326 run osmo-hlr_10.42.42.2(pid=21895): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21895)] 16:23:01.494304 run osmo-hlr_10.42.42.2(pid=21895): stdout: | (launched: 2022-12-09_16:22:58.374463) 16:23:01.548301 run osmo-hlr_10.42.42.2(pid=21895): stderr: | [0;m[1;31m20221209162258570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162258570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162258570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162258570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162258570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162258571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162258583 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162258592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162258592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162258592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:01.622613 run osmo-msc_10.42.42.6(pid=21901): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21901)] 16:23:01.674757 run osmo-msc_10.42.42.6(pid=21901): stdout: | (launched: 2022-12-09_16:23:00.373099) 16:23:01.728306 run osmo-msc_10.42.42.6(pid=21901): stderr: | [0;m[38;5;43m20221209162300691 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162300692 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f41acec7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162300692 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162300692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162300692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162300692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162300694 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162300694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162300694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162300695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:23:01.782289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21894): Terminating (SIGTERM) 16:23:01.831252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21897): Terminating (SIGTERM) 16:23:01.881048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21900): Terminating (SIGTERM) 16:23:01.929140 --- ParallelTerminationStrategy: PID 21894 died... 16:23:01.949790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21894): Terminated: ok {rc=0} 16:23:01.999023 --- ParallelTerminationStrategy: PID 21897 died... 16:23:02.019437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21897): Terminated: ok {rc=0} 16:23:02.077876 --- ParallelTerminationStrategy: PID 21900 died... 16:23:02.102853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21900): Terminated: ok {rc=0} 16:23:02.206456 bus /sierra_3: Setting Powered False 16:23:03.331990 bus /sierra_3: Setting Powered False 16:23:04.459301 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:23:05.708401 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:23:05.718424 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:23:05.756325 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:23:05.785772 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:23:05.842704 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:23:05.878280 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:23:05.907477 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:23:06.454076 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:23:06.509083 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:06.521777 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:23:06.595356 tst mo_mt_call.py: using LAC 22259 16:23:06.725536 tst mo_mt_call.py: using RAC 74 16:23:06.853389 tst mo_mt_call.py: using CellId 22259 16:23:06.980383 tst mo_mt_call.py: using BVCI 22260 16:23:07.098913 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:07.111510 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:07.125359 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:07.138779 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:07.151085 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:07.165094 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:23:07.290606 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:23:07.415395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:07.927339 run create_hlr_db(pid=22177): Launched 16:23:08.092490 bus /sierra_2: Setting Powered False 16:23:09.158782 run create_hlr_db(pid=22177): Terminated: ok {rc=0} 16:23:09.627497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22179): Launched 16:23:09.975413 run osmo-hlr_10.42.42.2(pid=22180): Launched 16:23:10.227054 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:10.899552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22182): Launched 16:23:11.246123 run osmo-stp_10.42.42.5(pid=22183): Launched 16:23:11.496830 run osmo-msc_10.42.42.6: Starting osmo-msc 16:23:12.179906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22185): Launched 16:23:12.523265 run osmo-msc_10.42.42.6(pid=22186): Launched 16:23:12.888106 run osmo-stp_10.42.42.5(pid=22183): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22183)] 16:23:13.175974 run osmo-stp_10.42.42.5(pid=22183): stdout: | (launched: 2022-12-09_16:23:11.184296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:13.350778 run osmo-stp_10.42.42.5(pid=22183): stderr: | [0;m[38;5;43m20221209162311485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162311485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162311485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162311485 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162311486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162311486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162311486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:13.491513 run osmo-stp_10.42.42.5(pid=22183): stdout: | (launched: 2022-12-09_16:23:11.184296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:13.626813 run osmo-stp_10.42.42.5(pid=22183): stderr: | [0;m[38;5;43m20221209162311485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162311485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162311485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162311485 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162311486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162311486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162311486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:13.787835 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22183): Process ended prematurely: osmo-stp_10.42.42.5(pid=22183) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22183)] [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:23:13.798549 tst mo_mt_call.py:8: Test FAILED (7.3 sec) 16:23:13.829731 run osmo-hlr_10.42.42.2(pid=22180): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22180)] 16:23:13.882308 run osmo-hlr_10.42.42.2(pid=22180): stdout: | (launched: 2022-12-09_16:23:09.913895) 16:23:13.936458 run osmo-hlr_10.42.42.2(pid=22180): stderr: | [0;m[1;31m20221209162310214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162310214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162310214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162310214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162310214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162310214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162310235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162310247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162310248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162310248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:14.012667 run osmo-msc_10.42.42.6(pid=22186): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22186)] 16:23:14.065595 run osmo-msc_10.42.42.6(pid=22186): stdout: | (launched: 2022-12-09_16:23:12.463619) 16:23:14.119512 run osmo-msc_10.42.42.6(pid=22186): stderr: | [0;m[38;5;43m20221209162312964 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162312964 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f99c4c9dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162312964 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162312964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162312964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162312973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162312976 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162312976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162312976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162312976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:23:14.174885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22179): Terminating (SIGTERM) 16:23:14.219766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22182): Terminating (SIGTERM) 16:23:14.266094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22185): Terminating (SIGTERM) 16:23:14.312662 --- ParallelTerminationStrategy: PID 22179 died... 16:23:14.333537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22179): Terminated: ok {rc=0} 16:23:14.385789 --- ParallelTerminationStrategy: PID 22182 died... 16:23:14.406512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22182): Terminated: ok {rc=0} 16:23:14.456190 --- ParallelTerminationStrategy: PID 22185 died... 16:23:14.476768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22185): Terminated: ok {rc=0} 16:23:14.571435 bus /sierra_3: Setting Powered False 16:23:15.676185 bus /sierra_3: Setting Powered False 16:23:16.818744 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:23:17.995641 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:18.008651 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:23:18.080104 tst mo_mt_call_osmux.py: using LAC 22260 16:23:18.201334 tst mo_mt_call_osmux.py: using RAC 75 16:23:18.326517 tst mo_mt_call_osmux.py: using CellId 22260 16:23:18.448500 tst mo_mt_call_osmux.py: using BVCI 22261 16:23:18.562942 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:18.575470 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:18.588055 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:18.600152 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:18.612476 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:23:18.625304 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:23:18.746126 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:23:18.871263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:19.352198 run create_hlr_db(pid=22188): Launched 16:23:19.515913 bus /sierra_2: Setting Powered False 16:23:20.579544 run create_hlr_db(pid=22188): Terminated: ok {rc=0} 16:23:21.019118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22190): Launched 16:23:21.350372 run osmo-hlr_10.42.42.2(pid=22191): Launched 16:23:21.587587 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:22.311825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22193): Launched 16:23:22.642510 run osmo-stp_10.42.42.5(pid=22194): Launched 16:23:22.880629 run osmo-msc_10.42.42.6: Starting osmo-msc 16:23:23.584657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22197): Launched 16:23:23.886574 run osmo-msc_10.42.42.6(pid=22198): Launched 16:23:24.054706 run osmo-stp_10.42.42.5(pid=22194): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22194)] 16:23:24.181146 run osmo-stp_10.42.42.5(pid=22194): stdout: | (launched: 2022-12-09_16:23:22.581288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:24.307835 run osmo-stp_10.42.42.5(pid=22194): stderr: | [0;m[38;5;43m20221209162322907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162322907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162322907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162322908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162322908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162322908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162322908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:24.432676 run osmo-stp_10.42.42.5(pid=22194): stdout: | (launched: 2022-12-09_16:23:22.581288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:24.551618 run osmo-stp_10.42.42.5(pid=22194): stderr: | [0;m[38;5;43m20221209162322907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162322907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162322907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162322908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162322908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162322908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162322908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:24.694942 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22194): Process ended prematurely: osmo-stp_10.42.42.5(pid=22194) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22194)] [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:23:24.703564 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 16:23:24.729886 run osmo-hlr_10.42.42.2(pid=22191): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22191)] 16:23:24.776682 run osmo-hlr_10.42.42.2(pid=22191): stdout: | (launched: 2022-12-09_16:23:21.288681) 16:23:24.825522 run osmo-hlr_10.42.42.2(pid=22191): stderr: | [0;m[1;31m20221209162321630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162321630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162321630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162321630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162321630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162321630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162321651 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162321664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162321673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162321673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:24.893742 run osmo-msc_10.42.42.6(pid=22198): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22198)] 16:23:24.940748 run osmo-msc_10.42.42.6(pid=22198): stdout: | (launched: 2022-12-09_16:23:23.831087) 16:23:24.989509 run osmo-msc_10.42.42.6(pid=22198): stderr: | [0;m[38;5;43m20221209162324103 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162324103 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f13a5a7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162324103 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162324103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162324103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162324104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162324106 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162324107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162324107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162324107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:23:25.038782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22190): Terminating (SIGTERM) 16:23:25.077797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22193): Terminating (SIGTERM) 16:23:25.116871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22197): Terminating (SIGTERM) 16:23:25.156189 --- ParallelTerminationStrategy: PID 22190 died... 16:23:25.175100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22190): Terminated: ok {rc=0} 16:23:25.218635 --- ParallelTerminationStrategy: PID 22193 died... 16:23:25.237342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22193): Terminated: ok {rc=0} 16:23:25.281195 --- ParallelTerminationStrategy: PID 22197 died... 16:23:25.299461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22197): Terminated: ok {rc=0} 16:23:25.385657 bus /sierra_3: Setting Powered False 16:23:26.485274 bus /sierra_3: Setting Powered False 16:23:27.600982 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:23:28.850731 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:23:28.857962 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:23:28.892744 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:23:28.920200 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:23:28.973727 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:23:29.007926 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:23:29.035589 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:23:29.587017 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:23:29.639306 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:29.650871 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:23:29.721687 tst mo_mt_call.py: using LAC 22261 16:23:29.848298 tst mo_mt_call.py: using RAC 76 16:23:29.973379 tst mo_mt_call.py: using CellId 22261 16:23:30.101183 tst mo_mt_call.py: using BVCI 22262 16:23:30.219830 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:30.231403 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:30.242803 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:30.254455 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:30.266519 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:30.278453 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:23:30.399852 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:23:30.516469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:31.014447 run create_hlr_db(pid=22203): Launched 16:23:31.175418 bus /sierra_2: Setting Powered False 16:23:32.234415 run create_hlr_db(pid=22203): Terminated: ok {rc=0} 16:23:32.689192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22205): Launched 16:23:32.992343 run osmo-hlr_10.42.42.2(pid=22206): Launched 16:23:33.106957 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:33.641252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22208): Launched 16:23:33.942022 run osmo-stp_10.42.42.5(pid=22209): Launched 16:23:34.057943 run osmo-msc_10.42.42.6: Starting osmo-msc 16:23:34.598490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22211): Launched 16:23:34.901401 run osmo-msc_10.42.42.6(pid=22212): Launched 16:23:35.070403 run osmo-stp_10.42.42.5(pid=22209): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22209)] 16:23:35.197898 run osmo-stp_10.42.42.5(pid=22209): stdout: | (launched: 2022-12-09_16:23:33.886909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:35.325376 run osmo-stp_10.42.42.5(pid=22209): stderr: | [0;m[38;5;43m20221209162334058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162334058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162334058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162334059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162334059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162334059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162334059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:35.450814 run osmo-stp_10.42.42.5(pid=22209): stdout: | (launched: 2022-12-09_16:23:33.886909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:35.570025 run osmo-stp_10.42.42.5(pid=22209): stderr: | [0;m[38;5;43m20221209162334058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162334058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162334058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162334059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162334059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162334059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162334059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:35.712320 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22209): Process ended prematurely: osmo-stp_10.42.42.5(pid=22209) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22209)] [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:23:35.721212 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:23:35.747222 run osmo-hlr_10.42.42.2(pid=22206): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22206)] 16:23:35.794943 run osmo-hlr_10.42.42.2(pid=22206): stdout: | (launched: 2022-12-09_16:23:32.936759) 16:23:35.843950 run osmo-hlr_10.42.42.2(pid=22206): stderr: | [0;m[1;31m20221209162333112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162333112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162333112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162333112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162333112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162333112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162333122 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162333131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162333132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162333132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:35.912498 run osmo-msc_10.42.42.6(pid=22212): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22212)] 16:23:35.959591 run osmo-msc_10.42.42.6(pid=22212): stdout: | (launched: 2022-12-09_16:23:34.846369) 16:23:36.008259 run osmo-msc_10.42.42.6(pid=22212): stderr: | [0;m[38;5;43m20221209162335119 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162335119 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb73426bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162335119 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162335119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162335119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162335120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162335121 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162335122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162335122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162335122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:23:36.057405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22205): Terminating (SIGTERM) 16:23:36.096357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22208): Terminating (SIGTERM) 16:23:36.135416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22211): Terminating (SIGTERM) 16:23:36.174717 --- ParallelTerminationStrategy: PID 22205 died... 16:23:36.193507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22205): Terminated: ok {rc=0} 16:23:36.237025 --- ParallelTerminationStrategy: PID 22208 died... 16:23:36.255418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22208): Terminated: ok {rc=0} 16:23:36.299235 --- ParallelTerminationStrategy: PID 22211 died... 16:23:36.317624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22211): Terminated: ok {rc=0} 16:23:36.402446 bus /sierra_3: Setting Powered False 16:23:37.503473 bus /sierra_3: Setting Powered False 16:23:38.619925 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:23:39.767397 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:39.780141 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:23:39.852777 tst mo_mt_call_osmux.py: using LAC 22262 16:23:39.978451 tst mo_mt_call_osmux.py: using RAC 77 16:23:40.105689 tst mo_mt_call_osmux.py: using CellId 22262 16:23:40.233178 tst mo_mt_call_osmux.py: using BVCI 22263 16:23:40.350441 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:40.362534 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:40.374046 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:40.385824 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:40.397769 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:23:40.409870 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:23:40.530688 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:23:40.648914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:41.149598 run create_hlr_db(pid=22214): Launched 16:23:41.274403 bus /sierra_2: Setting Powered False 16:23:42.338347 run create_hlr_db(pid=22214): Terminated: ok {rc=0} 16:23:42.774714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22216): Launched 16:23:43.101577 run osmo-hlr_10.42.42.2(pid=22217): Launched 16:23:43.227092 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:43.785469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22219): Launched 16:23:44.107963 run osmo-stp_10.42.42.5(pid=22220): Launched 16:23:44.232369 run osmo-msc_10.42.42.6: Starting osmo-msc 16:23:44.823279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22222): Launched 16:23:45.150255 run osmo-msc_10.42.42.6(pid=22223): Launched 16:23:45.332523 run osmo-stp_10.42.42.5(pid=22220): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22220)] 16:23:45.469324 run osmo-stp_10.42.42.5(pid=22220): stdout: | (launched: 2022-12-09_16:23:44.049365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:45.606992 run osmo-stp_10.42.42.5(pid=22220): stderr: | [0;m[38;5;43m20221209162344243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162344243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162344243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162344243 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162344244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162344244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162344244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:45.743702 run osmo-stp_10.42.42.5(pid=22220): stdout: | (launched: 2022-12-09_16:23:44.049365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:45.882375 run osmo-stp_10.42.42.5(pid=22220): stderr: | [0;m[38;5;43m20221209162344243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162344243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162344243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162344243 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162344244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162344244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162344244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:46.048366 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22220): Process ended prematurely: osmo-stp_10.42.42.5(pid=22220) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22220)] [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:23:46.058502 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:23:46.085960 run osmo-hlr_10.42.42.2(pid=22217): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22217)] 16:23:46.134609 run osmo-hlr_10.42.42.2(pid=22217): stdout: | (launched: 2022-12-09_16:23:43.043180) 16:23:46.186191 run osmo-hlr_10.42.42.2(pid=22217): stderr: | [0;m[1;31m20221209162343240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162343240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162343241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162343241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162343241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162343241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162343253 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162343262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162343262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162343262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:46.256270 run osmo-msc_10.42.42.6(pid=22223): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22223)] 16:23:46.304487 run osmo-msc_10.42.42.6(pid=22223): stdout: | (launched: 2022-12-09_16:23:45.091369) 16:23:46.354790 run osmo-msc_10.42.42.6(pid=22223): stderr: | [0;m[38;5;43m20221209162345413 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162345413 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f696425dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162345413 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162345413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162345413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162345413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162345415 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162345415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162345416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162345416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:23:46.406586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22216): Terminating (SIGTERM) 16:23:46.447664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22219): Terminating (SIGTERM) 16:23:46.490529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22222): Terminating (SIGTERM) 16:23:46.534305 --- ParallelTerminationStrategy: PID 22216 died... 16:23:46.554265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22216): Terminated: ok {rc=0} 16:23:46.602051 --- ParallelTerminationStrategy: PID 22219 died... 16:23:46.621262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22219): Terminated: ok {rc=0} 16:23:46.666727 --- ParallelTerminationStrategy: PID 22222 died... 16:23:46.685768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22222): Terminated: ok {rc=0} 16:23:46.771461 bus /sierra_3: Setting Powered False 16:23:47.871471 bus /sierra_3: Setting Powered False 16:23:48.984125 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:23:50.238756 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:23:50.245211 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:23:50.279071 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:23:50.305432 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:23:50.358559 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:23:50.393747 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:23:50.420899 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:23:50.969904 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:23:51.022928 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:51.034694 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:23:51.106078 tst mo_mt_call.py: using LAC 22263 16:23:51.234587 tst mo_mt_call.py: using RAC 78 16:23:51.360548 tst mo_mt_call.py: using CellId 22263 16:23:51.486229 tst mo_mt_call.py: using BVCI 22264 16:23:51.603834 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:51.615703 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:51.627189 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:51.639105 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:51.651125 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:23:51.663126 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:23:51.783466 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:23:51.901414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:52.367188 run create_hlr_db(pid=22228): Launched 16:23:52.490991 bus /sierra_2: Setting Powered False 16:23:53.551033 run create_hlr_db(pid=22228): Terminated: ok {rc=0} 16:23:53.993101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22230): Launched 16:23:54.316688 run osmo-hlr_10.42.42.2(pid=22231): Launched 16:23:54.440392 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:55.000203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22233): Launched 16:23:55.324020 run osmo-stp_10.42.42.5(pid=22234): Launched 16:23:55.447097 run osmo-msc_10.42.42.6: Starting osmo-msc 16:23:56.030814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22236): Launched 16:23:56.353267 run osmo-msc_10.42.42.6(pid=22237): Launched 16:23:56.533487 run osmo-stp_10.42.42.5(pid=22234): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22234)] 16:23:56.671042 run osmo-stp_10.42.42.5(pid=22234): stdout: | (launched: 2022-12-09_16:23:55.265130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:56.807987 run osmo-stp_10.42.42.5(pid=22234): stderr: | [0;m[38;5;43m20221209162355456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162355456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162355457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162355457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162355457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162355458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162355458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:56.944147 run osmo-stp_10.42.42.5(pid=22234): stdout: | (launched: 2022-12-09_16:23:55.265130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:57.072803 run osmo-stp_10.42.42.5(pid=22234): stderr: | [0;m[38;5;43m20221209162355456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162355456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162355457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162355457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162355457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162355458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162355458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:57.226601 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22234): Process ended prematurely: osmo-stp_10.42.42.5(pid=22234) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22234)] [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:23:57.236194 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:23:57.264623 run osmo-hlr_10.42.42.2(pid=22231): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22231)] 16:23:57.314650 run osmo-hlr_10.42.42.2(pid=22231): stdout: | (launched: 2022-12-09_16:23:54.258314) 16:23:57.366414 run osmo-hlr_10.42.42.2(pid=22231): stderr: | [0;m[1;31m20221209162354458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162354458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162354458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162354458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162354458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162354458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162354471 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162354479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162354479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162354479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:57.438198 run osmo-msc_10.42.42.6(pid=22237): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22237)] 16:23:57.488176 run osmo-msc_10.42.42.6(pid=22237): stdout: | (launched: 2022-12-09_16:23:56.294730) 16:23:57.539869 run osmo-msc_10.42.42.6(pid=22237): stderr: | [0;m[38;5;43m20221209162356615 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162356615 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe67a82fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162356615 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162356615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162356615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162356615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162356617 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162356618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162356618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162356618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:23:57.592363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22230): Terminating (SIGTERM) 16:23:57.634404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22233): Terminating (SIGTERM) 16:23:57.676326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22236): Terminating (SIGTERM) 16:23:57.718410 --- ParallelTerminationStrategy: PID 22230 died... 16:23:57.738219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22230): Terminated: ok {rc=0} 16:23:57.784581 --- ParallelTerminationStrategy: PID 22233 died... 16:23:57.804214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22233): Terminated: ok {rc=0} 16:23:57.850603 --- ParallelTerminationStrategy: PID 22236 died... 16:23:57.870090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22236): Terminated: ok {rc=0} 16:23:57.958155 bus /sierra_3: Setting Powered False 16:23:59.056808 bus /sierra_3: Setting Powered False 16:24:00.172998 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:24:01.317616 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:24:01.329991 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:24:01.401735 tst mo_mt_call_osmux.py: using LAC 22264 16:24:01.534903 tst mo_mt_call_osmux.py: using RAC 79 16:24:01.695982 tst mo_mt_call_osmux.py: using CellId 22264 16:24:01.823260 tst mo_mt_call_osmux.py: using BVCI 22265 16:24:01.939437 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:24:01.951789 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:24:01.965930 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:24:01.978891 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:24:01.991224 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:24:02.004260 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:24:02.125783 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:24:02.251258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:02.716635 run create_hlr_db(pid=22239): Launched 16:24:02.840123 bus /sierra_2: Setting Powered False 16:24:03.900522 run create_hlr_db(pid=22239): Terminated: ok {rc=0} 16:24:04.318734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22241): Launched 16:24:04.619391 run osmo-hlr_10.42.42.2(pid=22242): Launched 16:24:04.733563 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:05.247489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22244): Launched 16:24:05.547126 run osmo-stp_10.42.42.5(pid=22245): Launched 16:24:05.660849 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:06.203254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22247): Launched 16:24:06.504270 run osmo-msc_10.42.42.6(pid=22248): Launched 16:24:06.671875 run osmo-stp_10.42.42.5(pid=22245): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22245)] 16:24:06.797285 run osmo-stp_10.42.42.5(pid=22245): stdout: | (launched: 2022-12-09_16:24:05.492330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:06.923663 run osmo-stp_10.42.42.5(pid=22245): stderr: | [0;m[38;5;43m20221209162405663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162405663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162405663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162405664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162405666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162405666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162405666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:07.048187 run osmo-stp_10.42.42.5(pid=22245): stdout: | (launched: 2022-12-09_16:24:05.492330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:07.167297 run osmo-stp_10.42.42.5(pid=22245): stderr: | [0;m[38;5;43m20221209162405663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162405663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162405663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162405664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162405666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162405666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162405666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:07.310425 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22245): Process ended prematurely: osmo-stp_10.42.42.5(pid=22245) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22245)] [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:24:07.319297 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 16:24:07.345635 run osmo-hlr_10.42.42.2(pid=22242): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22242)] 16:24:07.392516 run osmo-hlr_10.42.42.2(pid=22242): stdout: | (launched: 2022-12-09_16:24:04.563733) 16:24:07.441281 run osmo-hlr_10.42.42.2(pid=22242): stderr: | [0;m[1;31m20221209162404739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162404739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162404739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162404739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162404739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162404739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162404757 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162404765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162404766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162404766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:07.509080 run osmo-msc_10.42.42.6(pid=22248): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22248)] 16:24:07.556265 run osmo-msc_10.42.42.6(pid=22248): stdout: | (launched: 2022-12-09_16:24:06.449319) 16:24:07.605051 run osmo-msc_10.42.42.6(pid=22248): stderr: | [0;m[38;5;43m20221209162406726 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162406726 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3b242d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162406726 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162406727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162406727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162406727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162406729 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162406729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162406729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162406729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:07.653933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22241): Terminating (SIGTERM) 16:24:07.693461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22244): Terminating (SIGTERM) 16:24:07.732750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22247): Terminating (SIGTERM) 16:24:07.772021 --- ParallelTerminationStrategy: PID 22241 died... 16:24:07.790907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22241): Terminated: ok {rc=0} 16:24:07.834838 --- ParallelTerminationStrategy: PID 22244 died... 16:24:07.853491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22244): Terminated: ok {rc=0} 16:24:07.896874 --- ParallelTerminationStrategy: PID 22247 died... 16:24:07.915665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22247): Terminated: ok {rc=0} 16:24:07.998094 bus /sierra_3: Setting Powered False 16:24:09.093811 bus /sierra_3: Setting Powered False 16:24:10.213574 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:24:11.467015 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:24:11.474086 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:24:11.508942 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:24:11.536277 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:24:11.590082 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:24:11.624165 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:24:11.651481 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:24:12.202804 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:24:12.251280 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:12.262723 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:24:12.332506 tst mo_mt_call.py: using LAC 22265 16:24:12.449946 tst mo_mt_call.py: using RAC 80 16:24:12.568609 tst mo_mt_call.py: using CellId 22265 16:24:12.686337 tst mo_mt_call.py: using BVCI 22266 16:24:12.796142 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:12.807344 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:12.818411 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:12.830175 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:12.841696 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:12.852884 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:24:12.973659 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:24:13.093820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:13.593089 run create_hlr_db(pid=22253): Launched 16:24:13.718123 bus /sierra_2: Setting Powered False 16:24:14.782756 run create_hlr_db(pid=22253): Terminated: ok {rc=0} 16:24:15.214433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22256): Launched 16:24:15.517300 run osmo-hlr_10.42.42.2(pid=22257): Launched 16:24:15.633199 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:16.215823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22259): Launched 16:24:16.538660 run osmo-stp_10.42.42.5(pid=22260): Launched 16:24:16.724241 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:17.460478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22262): Launched 16:24:17.785270 run osmo-msc_10.42.42.6(pid=22263): Launched 16:24:17.967155 run osmo-stp_10.42.42.5(pid=22260): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22260)] 16:24:18.103881 run osmo-stp_10.42.42.5(pid=22260): stdout: | (launched: 2022-12-09_16:24:16.478321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:18.241643 run osmo-stp_10.42.42.5(pid=22260): stderr: | [0;m[38;5;43m20221209162416820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162416820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162416820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162416833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162416833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162416834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162416834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:18.378555 run osmo-stp_10.42.42.5(pid=22260): stdout: | (launched: 2022-12-09_16:24:16.478321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:18.507235 run osmo-stp_10.42.42.5(pid=22260): stderr: | [0;m[38;5;43m20221209162416820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162416820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162416820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162416833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162416833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162416834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162416834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:18.662483 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22260): Process ended prematurely: osmo-stp_10.42.42.5(pid=22260) [trial-2361↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22260)] [trial-2361↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:24:18.671899 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:24:18.700003 run osmo-hlr_10.42.42.2(pid=22257): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22257)] 16:24:18.749821 run osmo-hlr_10.42.42.2(pid=22257): stdout: | (launched: 2022-12-09_16:24:15.462307) 16:24:18.801664 run osmo-hlr_10.42.42.2(pid=22257): stderr: | [0;m[1;31m20221209162415637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162415637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162415637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162415637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162415637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162415637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162415650 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162415660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162415660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162415660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:18.874110 run osmo-msc_10.42.42.6(pid=22263): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22263)] 16:24:18.923939 run osmo-msc_10.42.42.6(pid=22263): stdout: | (launched: 2022-12-09_16:24:17.726608) 16:24:18.975549 run osmo-msc_10.42.42.6(pid=22263): stderr: | [0;m[38;5;43m20221209162418050 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162418051 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4bf9083c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162418051 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162418051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162418051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162418051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162418053 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162418054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162418054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162418054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:19.027546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22256): Terminating (SIGTERM) 16:24:19.069168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22259): Terminating (SIGTERM) 16:24:19.110871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22262): Terminating (SIGTERM) 16:24:19.152566 --- ParallelTerminationStrategy: PID 22256 died... 16:24:19.172299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22256): Terminated: ok {rc=0} 16:24:19.218607 --- ParallelTerminationStrategy: PID 22259 died... 16:24:19.237856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22259): Terminated: ok {rc=0} 16:24:19.283696 --- ParallelTerminationStrategy: PID 22262 died... 16:24:19.303015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22262): Terminated: ok {rc=0} 16:24:19.389635 bus /sierra_3: Setting Powered False 16:24:20.488296 bus /sierra_3: Setting Powered False 16:24:21.605134 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:24:22.753223 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:22.765771 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:24:22.838469 tst mo_mt_call_osmux.py: using LAC 22266 16:24:22.965607 tst mo_mt_call_osmux.py: using RAC 81 16:24:23.083818 tst mo_mt_call_osmux.py: using CellId 22266 16:24:23.202976 tst mo_mt_call_osmux.py: using BVCI 22267 16:24:23.310908 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:23.322302 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:23.333584 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:23.344842 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:23.356292 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:24:23.367649 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:24:23.483297 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:24:23.601866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:24.102042 run create_hlr_db(pid=22265): Launched 16:24:24.227541 bus /sierra_2: Setting Powered False 16:24:25.291376 run create_hlr_db(pid=22265): Terminated: ok {rc=0} 16:24:25.724226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22267): Launched 16:24:26.027355 run osmo-hlr_10.42.42.2(pid=22268): Launched 16:24:26.142184 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:26.675844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22270): Launched 16:24:26.977651 run osmo-stp_10.42.42.5(pid=22271): Launched 16:24:27.092683 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:27.641098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22273): Launched 16:24:27.944814 run osmo-msc_10.42.42.6(pid=22274): Launched 16:24:28.113739 run osmo-stp_10.42.42.5(pid=22271): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22271)] 16:24:28.240501 run osmo-stp_10.42.42.5(pid=22271): stdout: | (launched: 2022-12-09_16:24:26.922506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:28.368326 run osmo-stp_10.42.42.5(pid=22271): stderr: | [0;m[38;5;43m20221209162427091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162427091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162427091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162427092 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162427092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162427092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162427092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:28.494384 run osmo-stp_10.42.42.5(pid=22271): stdout: | (launched: 2022-12-09_16:24:26.922506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:28.614729 run osmo-stp_10.42.42.5(pid=22271): stderr: | [0;m[38;5;43m20221209162427091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162427091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162427091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162427092 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162427092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162427092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162427092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:28.760663 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22271): Process ended prematurely: osmo-stp_10.42.42.5(pid=22271) [trial-2361↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22271)] [trial-2361↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:24:28.769999 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 16:24:28.796430 run osmo-hlr_10.42.42.2(pid=22268): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22268)] 16:24:28.843968 run osmo-hlr_10.42.42.2(pid=22268): stdout: | (launched: 2022-12-09_16:24:25.972548) 16:24:28.893112 run osmo-hlr_10.42.42.2(pid=22268): stderr: | [0;m[1;31m20221209162426147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162426147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162426148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162426148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162426148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162426148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162426160 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162426171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162426172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162426172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:28.961671 run osmo-msc_10.42.42.6(pid=22274): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22274)] 16:24:29.008821 run osmo-msc_10.42.42.6(pid=22274): stdout: | (launched: 2022-12-09_16:24:27.889656) 16:24:29.057416 run osmo-msc_10.42.42.6(pid=22274): stderr: | [0;m[38;5;43m20221209162428162 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162428162 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2516530c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162428162 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162428162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162428163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162428163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162428166 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162428166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162428166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162428166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:29.106556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22267): Terminating (SIGTERM) 16:24:29.145899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22270): Terminating (SIGTERM) 16:24:29.185849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22273): Terminating (SIGTERM) 16:24:29.225688 --- ParallelTerminationStrategy: PID 22267 died... 16:24:29.244437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22267): Terminated: ok {rc=0} 16:24:29.288354 --- ParallelTerminationStrategy: PID 22270 died... 16:24:29.306963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22270): Terminated: ok {rc=0} 16:24:29.350538 --- ParallelTerminationStrategy: PID 22273 died... 16:24:29.369172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22273): Terminated: ok {rc=0} 16:24:29.454625 bus /sierra_3: Setting Powered False 16:24:30.551718 bus /sierra_3: Setting Powered False 16:24:31.662227 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:24:32.906577 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:24:32.912283 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:24:32.945266 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:24:32.971827 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:24:33.023722 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:24:33.056200 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:24:33.082484 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:24:33.632500 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:24:33.681214 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:33.692156 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:24:33.762388 tst mo_mt_call.py: using LAC 22267 16:24:33.882300 tst mo_mt_call.py: using RAC 82 16:24:34.003459 tst mo_mt_call.py: using CellId 22267 16:24:34.123439 tst mo_mt_call.py: using BVCI 22268 16:24:34.234122 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:34.245004 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:34.255694 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:34.266461 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:34.277286 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:34.288084 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:24:34.406168 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:24:34.522322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:34.987900 run create_hlr_db(pid=22279): Launched 16:24:35.111645 bus /sierra_2: Setting Powered False 16:24:36.172094 run create_hlr_db(pid=22279): Terminated: ok {rc=0} 16:24:36.613878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22281): Launched 16:24:36.938542 run osmo-hlr_10.42.42.2(pid=22282): Launched 16:24:37.063362 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:37.618933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22284): Launched 16:24:37.943039 run osmo-stp_10.42.42.5(pid=22285): Launched 16:24:38.067384 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:38.653517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22287): Launched 16:24:38.976429 run osmo-msc_10.42.42.6(pid=22288): Launched 16:24:39.157230 run osmo-stp_10.42.42.5(pid=22285): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22285)] 16:24:39.297802 run osmo-stp_10.42.42.5(pid=22285): stdout: | (launched: 2022-12-09_16:24:37.884085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:39.435743 run osmo-stp_10.42.42.5(pid=22285): stderr: | [0;m[38;5;43m20221209162438074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162438075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162438075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162438075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162438076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162438076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162438076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:39.572402 run osmo-stp_10.42.42.5(pid=22285): stdout: | (launched: 2022-12-09_16:24:37.884085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:39.701646 run osmo-stp_10.42.42.5(pid=22285): stderr: | [0;m[38;5;43m20221209162438074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162438075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162438075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162438075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162438076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162438076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162438076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:39.855852 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22285): Process ended prematurely: osmo-stp_10.42.42.5(pid=22285) [trial-2361↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22285)] [trial-2361↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:24:39.865345 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:24:39.893335 run osmo-hlr_10.42.42.2(pid=22282): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22282)] 16:24:39.943272 run osmo-hlr_10.42.42.2(pid=22282): stdout: | (launched: 2022-12-09_16:24:36.880020) 16:24:39.995289 run osmo-hlr_10.42.42.2(pid=22282): stderr: | [0;m[1;31m20221209162437079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162437079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162437079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162437079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162437079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162437079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162437092 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162437102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162437102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162437102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:40.067493 run osmo-msc_10.42.42.6(pid=22288): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22288)] 16:24:40.117144 run osmo-msc_10.42.42.6(pid=22288): stdout: | (launched: 2022-12-09_16:24:38.917853) 16:24:40.168500 run osmo-msc_10.42.42.6(pid=22288): stderr: | [0;m[38;5;43m20221209162439238 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162439238 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8f89009c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162439238 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162439238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162439239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162439239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162439240 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162439241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162439241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162439241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:40.220354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22281): Terminating (SIGTERM) 16:24:40.261763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22284): Terminating (SIGTERM) 16:24:40.303298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22287): Terminating (SIGTERM) 16:24:40.345005 --- ParallelTerminationStrategy: PID 22281 died... 16:24:40.364701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22281): Terminated: ok {rc=0} 16:24:40.411090 --- ParallelTerminationStrategy: PID 22284 died... 16:24:40.430741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22284): Terminated: ok {rc=0} 16:24:40.476726 --- ParallelTerminationStrategy: PID 22287 died... 16:24:40.495992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22287): Terminated: ok {rc=0} 16:24:40.582630 bus /sierra_3: Setting Powered False 16:24:41.681079 bus /sierra_3: Setting Powered False 16:24:42.795267 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:24:43.939778 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:43.951640 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:24:44.027844 tst mo_mt_call_osmux.py: using LAC 22268 16:24:44.145678 tst mo_mt_call_osmux.py: using RAC 83 16:24:44.264626 tst mo_mt_call_osmux.py: using CellId 22268 16:24:44.383906 tst mo_mt_call_osmux.py: using BVCI 22269 16:24:44.492399 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:44.503368 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:44.514125 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:44.525198 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:44.536551 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:24:44.547586 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:24:44.666466 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:24:44.781805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:45.246257 run create_hlr_db(pid=22290): Launched 16:24:45.371523 bus /sierra_2: Setting Powered False 16:24:46.433963 run create_hlr_db(pid=22290): Terminated: ok {rc=0} 16:24:46.875734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22292): Launched 16:24:47.226919 run osmo-hlr_10.42.42.2(pid=22293): Launched 16:24:47.352358 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:47.906756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22295): Launched 16:24:48.229680 run osmo-stp_10.42.42.5(pid=22296): Launched 16:24:48.351941 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:48.933202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22298): Launched 16:24:49.257758 run osmo-msc_10.42.42.6(pid=22299): Launched 16:24:49.439029 run osmo-stp_10.42.42.5(pid=22296): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22296)] 16:24:49.574935 run osmo-stp_10.42.42.5(pid=22296): stdout: | (launched: 2022-12-09_16:24:48.170792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:49.711949 run osmo-stp_10.42.42.5(pid=22296): stderr: | [0;m[38;5;43m20221209162448362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162448362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162448363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162448363 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162448366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162448366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162448366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:49.847906 run osmo-stp_10.42.42.5(pid=22296): stdout: | (launched: 2022-12-09_16:24:48.170792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:49.975856 run osmo-stp_10.42.42.5(pid=22296): stderr: | [0;m[38;5;43m20221209162448362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162448362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162448363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162448363 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162448366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162448366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162448366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:50.129708 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22296): Process ended prematurely: osmo-stp_10.42.42.5(pid=22296) [trial-2361↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22296)] [trial-2361↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:24:50.139131 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:24:50.167557 run osmo-hlr_10.42.42.2(pid=22293): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22293)] 16:24:50.217413 run osmo-hlr_10.42.42.2(pid=22293): stdout: | (launched: 2022-12-09_16:24:47.167263) 16:24:50.269136 run osmo-hlr_10.42.42.2(pid=22293): stderr: | [0;m[1;31m20221209162447363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162447363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162447363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162447363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162447364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162447364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162447376 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162447384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162447385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162447385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:50.341107 run osmo-msc_10.42.42.6(pid=22299): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22299)] 16:24:50.391049 run osmo-msc_10.42.42.6(pid=22299): stdout: | (launched: 2022-12-09_16:24:49.199187) 16:24:50.442829 run osmo-msc_10.42.42.6(pid=22299): stderr: | [0;m[38;5;43m20221209162449520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162449520 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f28c482ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162449520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162449520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162449520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162449520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162449522 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162449523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162449523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162449523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:50.495213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22292): Terminating (SIGTERM) 16:24:50.537062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22295): Terminating (SIGTERM) 16:24:50.578755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22298): Terminating (SIGTERM) 16:24:50.621327 --- ParallelTerminationStrategy: PID 22292 died... 16:24:50.641209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22292): Terminated: ok {rc=0} 16:24:50.687907 --- ParallelTerminationStrategy: PID 22295 died... 16:24:50.707327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22295): Terminated: ok {rc=0} 16:24:50.753579 --- ParallelTerminationStrategy: PID 22298 died... 16:24:50.773080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22298): Terminated: ok {rc=0} 16:24:50.860444 bus /sierra_3: Setting Powered False 16:24:51.957254 bus /sierra_3: Setting Powered False 16:24:53.072753 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 emergency:trx-lms --------------------------------------------------------------------- 16:24:54.323699 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:24:54.330412 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 16:24:54.365749 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 16:24:54.393288 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 16:24:54.477786 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 16:24:54.511889 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 16:24:54.539634 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 16:24:55.129544 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2361 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 16:24:55.134724 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:55.145816 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 16:24:55.197184 tst emergency_mo_mt_call.py: using LAC 22269 16:24:55.318844 tst emergency_mo_mt_call.py: using RAC 84 16:24:55.442640 tst emergency_mo_mt_call.py: using CellId 22269 16:24:55.564580 tst emergency_mo_mt_call.py: using BVCI 22270 16:24:55.679121 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:55.690235 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:55.701203 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:55.712413 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:55.723651 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:24:55.734787 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:24:55.849427 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:24:55.971383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:56.460868 run create_hlr_db(pid=22305): Launched 16:24:56.583441 bus /sierra_2: Setting Powered False 16:24:57.646425 run create_hlr_db(pid=22305): Terminated: ok {rc=0} 16:24:58.070492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22307): Launched 16:24:58.366437 run osmo-hlr_10.42.42.2(pid=22308): Launched 16:24:58.478855 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:59.002201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22310): Launched 16:24:59.297589 run osmo-stp_10.42.42.5(pid=22311): Launched 16:24:59.419597 tst emergency_mo_mt_call.py: using MSISDN 7267 16:24:59.571502 run osmo-msc_10.42.42.6: Starting osmo-msc 16:25:00.101285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22313): Launched 16:25:00.396572 run osmo-msc_10.42.42.6(pid=22314): Launched 16:25:00.560912 run osmo-stp_10.42.42.5(pid=22311): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22311)] 16:25:00.686264 run osmo-stp_10.42.42.5(pid=22311): stdout: | (launched: 2022-12-09_16:24:59.243743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:00.811060 run osmo-stp_10.42.42.5(pid=22311): stderr: | [0;m[38;5;43m20221209162459414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162459414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162459415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162459415 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162459416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162459416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162459416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:00.950134 run osmo-stp_10.42.42.5(pid=22311): stdout: | (launched: 2022-12-09_16:24:59.243743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:01.081842 run osmo-stp_10.42.42.5(pid=22311): stderr: | [0;m[38;5;43m20221209162459414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162459414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162459415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162459415 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162459416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162459416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162459416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:01.237742 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22311): Process ended prematurely: osmo-stp_10.42.42.5(pid=22311) [trial-2361↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22311)] [trial-2361↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 16:25:01.247648 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 16:25:01.278504 run osmo-hlr_10.42.42.2(pid=22308): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22308)] 16:25:01.330763 run osmo-hlr_10.42.42.2(pid=22308): stdout: | (launched: 2022-12-09_16:24:58.312231) 16:25:01.386759 run osmo-hlr_10.42.42.2(pid=22308): stderr: | [0;m[1;31m20221209162458486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162458486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162458486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162458486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162458486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162458486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162458498 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162458509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162458510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162458510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:01.461309 run osmo-msc_10.42.42.6(pid=22314): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22314)] 16:25:01.513504 run osmo-msc_10.42.42.6(pid=22314): stdout: | (launched: 2022-12-09_16:25:00.342028) 16:25:01.568864 run osmo-msc_10.42.42.6(pid=22314): stderr: | [0;m[38;5;43m20221209162500615 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162500616 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb709181c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162500616 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162500616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162500616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162500616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162500618 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162500618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162500619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162500619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:25:01.624155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22307): Terminating (SIGTERM) 16:25:01.677941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22310): Terminating (SIGTERM) 16:25:01.730892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22313): Terminating (SIGTERM) 16:25:01.781875 --- ParallelTerminationStrategy: PID 22307 died... 16:25:01.802600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22307): Terminated: ok {rc=0} 16:25:01.853646 --- ParallelTerminationStrategy: PID 22310 died... 16:25:01.875562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22310): Terminated: ok {rc=0} 16:25:01.925227 --- ParallelTerminationStrategy: PID 22313 died... 16:25:01.947489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22313): Terminated: ok {rc=0} 16:25:02.040540 bus /sierra_3: Setting Powered False 16:25:03.140392 bus /sierra_3: Setting Powered False 16:25:04.254833 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 16:25:05.343224 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:25:05.354818 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 16:25:05.406703 tst emergency_preemptive_call.py: using LAC 22270 16:25:05.523974 tst emergency_preemptive_call.py: using RAC 85 16:25:05.650396 tst emergency_preemptive_call.py: using CellId 22270 16:25:05.776251 tst emergency_preemptive_call.py: using BVCI 22271 16:25:05.890946 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:25:05.902506 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:25:05.913626 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:25:05.925059 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:25:05.936396 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:25:05.947532 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:25:06.061372 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:25:06.179836 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:25:06.294426 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:25:06.411168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:06.903919 run create_hlr_db(pid=22319): Launched 16:25:07.024553 bus /sierra_2: Setting Powered False 16:25:08.087992 run create_hlr_db(pid=22319): Terminated: ok {rc=0} 16:25:08.512302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22321): Launched 16:25:08.808226 run osmo-hlr_10.42.42.2(pid=22322): Launched 16:25:08.921047 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:09.427474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22324): Launched 16:25:09.723860 run osmo-stp_10.42.42.5(pid=22325): Launched 16:25:09.847630 tst emergency_preemptive_call.py: using MSISDN 7268 16:25:09.999136 run osmo-msc_10.42.42.6: Starting osmo-msc 16:25:10.528784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22327): Launched 16:25:10.823840 run osmo-msc_10.42.42.6(pid=22328): Launched 16:25:10.988619 run osmo-stp_10.42.42.5(pid=22325): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22325)] 16:25:11.113538 run osmo-stp_10.42.42.5(pid=22325): stdout: | (launched: 2022-12-09_16:25:09.668672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:11.238238 run osmo-stp_10.42.42.5(pid=22325): stderr: | [0;m[38;5;43m20221209162509840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162509840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162509841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162509841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162509842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162509842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162509842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:11.360465 run osmo-stp_10.42.42.5(pid=22325): stdout: | (launched: 2022-12-09_16:25:09.668672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:11.477695 run osmo-stp_10.42.42.5(pid=22325): stderr: | [0;m[38;5;43m20221209162509840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162509840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162509841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162509841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162509842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162509842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162509842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:11.618101 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=22325): Process ended prematurely: osmo-stp_10.42.42.5(pid=22325) [trial-2361↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22325)] [trial-2361↪emergency:trx-lms↪emergency_preemptive_call.py:32] 16:25:11.626268 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 16:25:11.652037 run osmo-hlr_10.42.42.2(pid=22322): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22322)] 16:25:11.699374 run osmo-hlr_10.42.42.2(pid=22322): stdout: | (launched: 2022-12-09_16:25:08.754222) 16:25:11.748906 run osmo-hlr_10.42.42.2(pid=22322): stderr: | [0;m[1;31m20221209162508928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162508928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162508928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162508928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162508928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162508928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162508939 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162508948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162508949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162508949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:11.817430 run osmo-msc_10.42.42.6(pid=22328): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22328)] 16:25:11.864541 run osmo-msc_10.42.42.6(pid=22328): stdout: | (launched: 2022-12-09_16:25:10.769767) 16:25:11.913432 run osmo-msc_10.42.42.6(pid=22328): stderr: | [0;m[38;5;43m20221209162511040 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162511040 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa2f8725c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162511040 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162511040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162511040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162511041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162511042 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162511043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162511043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162511043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:25:11.962622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22321): Terminating (SIGTERM) 16:25:12.001792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22324): Terminating (SIGTERM) 16:25:12.041122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22327): Terminating (SIGTERM) 16:25:12.081394 --- ParallelTerminationStrategy: PID 22321 died... 16:25:12.100151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22321): Terminated: ok {rc=0} 16:25:12.143674 --- ParallelTerminationStrategy: PID 22324 died... 16:25:12.162245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22324): Terminated: ok {rc=0} 16:25:12.206672 --- ParallelTerminationStrategy: PID 22327 died... 16:25:12.225214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22327): Terminated: ok {rc=0} 16:25:12.306877 bus /sierra_9: Setting Powered False 16:25:13.403135 bus /sierra_9: Setting Powered False 16:25:14.519639 bus /sierra_8: Setting Powered False 16:25:15.616548 bus /sierra_8: Setting Powered False 16:25:16.728916 bus /sierra_3: Setting Powered False 16:25:17.825451 bus /sierra_3: Setting Powered False 16:25:18.939702 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-lms --------------------------------------------------------------------- 16:25:20.218242 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:25:20.222541 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 16:25:20.255500 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 16:25:20.294726 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 16:25:20.381889 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 16:25:20.414580 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 16:25:20.452796 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 16:25:21.045885 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 16:25:21.100805 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:21.111934 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:25:21.160654 tst cs_paging_gprs_active.py: using LAC 22271 16:25:21.284788 tst cs_paging_gprs_active.py: using RAC 86 16:25:21.409357 tst cs_paging_gprs_active.py: using CellId 22271 16:25:21.533344 tst cs_paging_gprs_active.py: using BVCI 22272 16:25:21.651169 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:21.662476 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:21.673479 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:21.684574 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:21.695802 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:21.706992 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:21.718291 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:21.729337 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:21.740424 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:21.862805 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:21.981533 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:25:22.184171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:25:22.488173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22341): Launched 16:25:22.752342 run iperf3-srv_10.42.42.10(pid=22342): Launched 16:25:22.865499 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:25:23.066795 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:25:23.369499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22343): Launched 16:25:23.631592 run iperf3-srv_10.42.42.10(pid=22344): Launched 16:25:23.744161 tst cs_paging_gprs_active.py:38: start network... 16:25:23.946396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:24.413173 run create_hlr_db(pid=22345): Launched 16:25:24.537803 bus /sierra_2: Setting Powered False 16:25:25.602027 run create_hlr_db(pid=22345): Terminated: ok {rc=0} 16:25:26.053112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22347): Launched 16:25:26.376907 run osmo-hlr_10.42.42.2(pid=22348): Launched 16:25:26.503194 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:27.063698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22350): Launched 16:25:27.387393 run osmo-stp_10.42.42.5(pid=22351): Launched 16:25:27.510818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:25:28.069770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22353): Launched 16:25:28.195281 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:25:28.468261 run patchelf(pid=22354): Launched 16:25:28.650457 run osmo-stp_10.42.42.5(pid=22351): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22351)] 16:25:28.788233 run osmo-stp_10.42.42.5(pid=22351): stdout: | (launched: 2022-12-09_16:25:27.328764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:28.927586 run osmo-stp_10.42.42.5(pid=22351): stderr: | [0;m[38;5;43m20221209162527519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162527519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162527519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162527520 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162527520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162527520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162527520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:29.066821 run osmo-stp_10.42.42.5(pid=22351): stdout: | (launched: 2022-12-09_16:25:27.328764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:29.199479 run osmo-stp_10.42.42.5(pid=22351): stderr: | [0;m[38;5;43m20221209162527519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162527519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162527519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162527520 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162527520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162527520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162527520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:29.356790 run patchelf(pid=22354): Terminating (SIGINT) 16:25:29.538777 run patchelf(pid=22354): Terminated: ok {rc=0} 16:25:29.670311 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22351): Process ended prematurely: osmo-stp_10.42.42.5(pid=22351) [trial-2361↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22351)] [trial-2361↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 16:25:29.680470 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 16:25:29.709786 run osmo-hlr_10.42.42.2(pid=22348): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22348)] 16:25:29.760368 run osmo-hlr_10.42.42.2(pid=22348): stdout: | (launched: 2022-12-09_16:25:26.318218) 16:25:29.812706 run osmo-hlr_10.42.42.2(pid=22348): stderr: | [0;m[1;31m20221209162526517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162526517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162526517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162526517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162526517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162526517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162526534 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162526544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162526545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162526545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:29.865787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22341): Terminating (SIGTERM) 16:25:29.908188 run iperf3-srv_10.42.42.10(pid=22342): Terminating (SIGTERM) 16:25:29.950861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22343): Terminating (SIGTERM) 16:25:29.993572 run iperf3-srv_10.42.42.10(pid=22344): Terminating (SIGTERM) 16:25:30.035936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22347): Terminating (SIGTERM) 16:25:30.078592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22350): Terminating (SIGTERM) 16:25:30.121089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22353): Terminating (SIGTERM) 16:25:30.163809 --- ParallelTerminationStrategy: PID 22341 died... 16:25:30.183970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22341): Terminated: ok {rc=0} 16:25:30.231119 --- ParallelTerminationStrategy: PID 22342 died... 16:25:30.250766 run iperf3-srv_10.42.42.10(pid=22342): Terminated {rc=256} 16:25:30.297085 --- ParallelTerminationStrategy: PID 22343 died... 16:25:30.316639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22343): Terminated: ok {rc=0} 16:25:30.363011 --- ParallelTerminationStrategy: PID 22344 died... 16:25:30.382584 run iperf3-srv_10.42.42.10(pid=22344): Terminated {rc=256} 16:25:30.428791 --- ParallelTerminationStrategy: PID 22347 died... 16:25:30.448598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22347): Terminated: ok {rc=0} 16:25:30.494761 --- ParallelTerminationStrategy: PID 22350 died... 16:25:30.514148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22350): Terminated: ok {rc=0} 16:25:30.560420 --- ParallelTerminationStrategy: PID 22353 died... 16:25:30.580003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22353): Terminated: ok {rc=0} 16:25:30.667176 bus /gobi_0: Setting Powered False 16:25:31.769426 bus /gobi_0: Setting Powered False 16:25:32.883689 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms iperf3.py ---------------------------------------------- 16:25:34.032681 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:34.044561 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:25:34.097957 tst iperf3.py: using LAC 22272 16:25:34.224787 tst iperf3.py: using RAC 87 16:25:34.349373 tst iperf3.py: using CellId 22272 16:25:34.475473 tst iperf3.py: using BVCI 22273 16:25:34.592317 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:34.603413 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:34.614356 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:34.625814 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:34.636783 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:34.647890 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:34.659436 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:34.670724 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:34.681922 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:34.800727 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:25:35.020940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:25:35.346537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22355): Launched 16:25:35.630751 run iperf3-srv_10.42.42.10(pid=22356): Launched 16:25:35.754211 tst iperf3.py:8: start network... 16:25:35.973841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:36.446562 run create_hlr_db(pid=22357): Launched 16:25:36.571387 bus /gobi_6: Setting Powered False 16:25:37.631539 run create_hlr_db(pid=22357): Terminated: ok {rc=0} 16:25:38.054076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22359): Launched 16:25:38.358142 run osmo-hlr_10.42.42.2(pid=22360): Launched 16:25:38.472920 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:38.990971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22362): Launched 16:25:39.293314 run osmo-stp_10.42.42.5(pid=22363): Launched 16:25:39.407665 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:25:39.926614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22365): Launched 16:25:40.042640 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:25:40.298011 run patchelf(pid=22366): Launched 16:25:40.468920 run osmo-stp_10.42.42.5(pid=22363): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22363)] 16:25:40.596392 run osmo-stp_10.42.42.5(pid=22363): stdout: | (launched: 2022-12-09_16:25:39.238200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:40.725537 run osmo-stp_10.42.42.5(pid=22363): stderr: | [0;m[38;5;43m20221209162539410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162539410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162539410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162539411 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162539411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162539411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162539411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:40.854634 run osmo-stp_10.42.42.5(pid=22363): stdout: | (launched: 2022-12-09_16:25:39.238200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:40.977206 run osmo-stp_10.42.42.5(pid=22363): stderr: | [0;m[38;5;43m20221209162539410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162539410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162539410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162539411 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162539411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162539411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162539411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:41.122586 run patchelf(pid=22366): Terminating (SIGINT) 16:25:41.291360 run patchelf(pid=22366): Terminated: ok {rc=0} 16:25:41.412804 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22363): Process ended prematurely: osmo-stp_10.42.42.5(pid=22363) [trial-2361↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22363)] [trial-2361↪gprs:trx-lms↪iperf3.py:8] 16:25:41.422183 tst iperf3.py:8: Test FAILED (7.4 sec) 16:25:41.449284 run osmo-hlr_10.42.42.2(pid=22360): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22360)] 16:25:41.496625 run osmo-hlr_10.42.42.2(pid=22360): stdout: | (launched: 2022-12-09_16:25:38.302544) 16:25:41.545750 run osmo-hlr_10.42.42.2(pid=22360): stderr: | [0;m[1;31m20221209162538479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162538479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162538479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162538479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162538479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162538479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162538491 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162538502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162538502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162538502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:41.595242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22355): Terminating (SIGTERM) 16:25:41.634446 run iperf3-srv_10.42.42.10(pid=22356): Terminating (SIGTERM) 16:25:41.673462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22359): Terminating (SIGTERM) 16:25:41.712403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22362): Terminating (SIGTERM) 16:25:41.751492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22365): Terminating (SIGTERM) 16:25:41.790886 --- ParallelTerminationStrategy: PID 22355 died... 16:25:41.809832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22355): Terminated: ok {rc=0} 16:25:41.853239 --- ParallelTerminationStrategy: PID 22356 died... 16:25:41.871415 run iperf3-srv_10.42.42.10(pid=22356): Terminated {rc=256} 16:25:41.914733 --- ParallelTerminationStrategy: PID 22359 died... 16:25:41.933531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22359): Terminated: ok {rc=0} 16:25:41.977285 --- ParallelTerminationStrategy: PID 22362 died... 16:25:41.995600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22362): Terminated: ok {rc=0} 16:25:42.038805 --- ParallelTerminationStrategy: PID 22365 died... 16:25:42.057431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22365): Terminated: ok {rc=0} 16:25:42.141613 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms iperf3m4.py ---------------------------------------------- 16:25:43.291432 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:43.303208 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:25:43.355442 tst iperf3m4.py: using LAC 22273 16:25:43.482722 tst iperf3m4.py: using RAC 88 16:25:43.608601 tst iperf3m4.py: using CellId 22273 16:25:43.737407 tst iperf3m4.py: using BVCI 22274 16:25:43.856056 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:43.867245 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:43.878241 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:43.889948 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:43.901458 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:43.912870 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:43.924940 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:43.936490 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:25:43.948112 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:44.067988 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:44.191917 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:44.312124 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:25:44.433202 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:25:44.653444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:25:44.977490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22367): Launched 16:25:45.258528 run iperf3-srv_10.42.42.10(pid=22368): Launched 16:25:45.382266 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:25:45.601311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:25:45.961049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22369): Launched 16:25:46.258192 run iperf3-srv_10.42.42.10(pid=22370): Launched 16:25:46.390195 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:25:46.599882 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:25:46.913706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22371): Launched 16:25:47.200863 run iperf3-srv_10.42.42.10(pid=22372): Launched 16:25:47.332161 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:25:47.551312 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:25:47.876755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22373): Launched 16:25:48.158690 run iperf3-srv_10.42.42.10(pid=22374): Launched 16:25:48.280375 tst iperf3m4.py:8: start network... 16:25:48.499792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:49.001992 run create_hlr_db(pid=22375): Launched 16:25:49.126272 bus /gobi_6: Setting Powered False 16:25:50.187452 run create_hlr_db(pid=22375): Terminated: ok {rc=0} 16:25:50.610146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22377): Launched 16:25:50.913442 run osmo-hlr_10.42.42.2(pid=22378): Launched 16:25:51.028300 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:51.549042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22380): Launched 16:25:51.851383 run osmo-stp_10.42.42.5(pid=22381): Launched 16:25:51.965173 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:25:52.482054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22383): Launched 16:25:52.598597 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:25:52.853128 run patchelf(pid=22384): Launched 16:25:53.020935 run osmo-stp_10.42.42.5(pid=22381): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22381)] 16:25:53.149255 run osmo-stp_10.42.42.5(pid=22381): stdout: | (launched: 2022-12-09_16:25:51.796050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:53.278704 run osmo-stp_10.42.42.5(pid=22381): stderr: | [0;m[38;5;43m20221209162551964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162551964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162551964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162551965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162551965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162551965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162551965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:53.408148 run osmo-stp_10.42.42.5(pid=22381): stdout: | (launched: 2022-12-09_16:25:51.796050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:53.531257 run osmo-stp_10.42.42.5(pid=22381): stderr: | [0;m[38;5;43m20221209162551964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162551964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162551964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162551965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162551965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162551965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162551965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:53.677495 run patchelf(pid=22384): Terminating (SIGINT) 16:25:53.846598 run patchelf(pid=22384): Terminated: ok {rc=0} 16:25:53.968523 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22381): Process ended prematurely: osmo-stp_10.42.42.5(pid=22381) [trial-2361↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22381)] [trial-2361↪gprs:trx-lms↪iperf3m4.py:8] 16:25:53.977963 tst iperf3m4.py:8: Test FAILED (10.7 sec) 16:25:54.005327 run osmo-hlr_10.42.42.2(pid=22378): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22378)] 16:25:54.052785 run osmo-hlr_10.42.42.2(pid=22378): stdout: | (launched: 2022-12-09_16:25:50.858173) 16:25:54.101480 run osmo-hlr_10.42.42.2(pid=22378): stderr: | [0;m[1;31m20221209162551034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162551034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162551034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162551034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162551034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162551034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162551046 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162551057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162551057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162551057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:54.150488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22367): Terminating (SIGTERM) 16:25:54.189839 run iperf3-srv_10.42.42.10(pid=22368): Terminating (SIGTERM) 16:25:54.229190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22369): Terminating (SIGTERM) 16:25:54.268424 run iperf3-srv_10.42.42.10(pid=22370): Terminating (SIGTERM) 16:25:54.307530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22371): Terminating (SIGTERM) 16:25:54.346868 run iperf3-srv_10.42.42.10(pid=22372): Terminating (SIGTERM) 16:25:54.386058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22373): Terminating (SIGTERM) 16:25:54.425177 run iperf3-srv_10.42.42.10(pid=22374): Terminating (SIGTERM) 16:25:54.465406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22377): Terminating (SIGTERM) 16:25:54.510989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22380): Terminating (SIGTERM) 16:25:54.553055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22383): Terminating (SIGTERM) 16:25:54.595335 --- ParallelTerminationStrategy: PID 22367 died... 16:25:54.615077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22367): Terminated: ok {rc=0} 16:25:54.662429 --- ParallelTerminationStrategy: PID 22368 died... 16:25:54.682571 run iperf3-srv_10.42.42.10(pid=22368): Terminated {rc=256} 16:25:54.728579 --- ParallelTerminationStrategy: PID 22369 died... 16:25:54.747935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22369): Terminated: ok {rc=0} 16:25:54.794551 --- ParallelTerminationStrategy: PID 22370 died... 16:25:54.814085 run iperf3-srv_10.42.42.10(pid=22370): Terminated {rc=256} 16:25:54.860107 --- ParallelTerminationStrategy: PID 22371 died... 16:25:54.879470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22371): Terminated: ok {rc=0} 16:25:54.925927 --- ParallelTerminationStrategy: PID 22372 died... 16:25:54.945464 run iperf3-srv_10.42.42.10(pid=22372): Terminated {rc=256} 16:25:54.991368 --- ParallelTerminationStrategy: PID 22373 died... 16:25:55.010538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22373): Terminated: ok {rc=0} 16:25:55.057081 --- ParallelTerminationStrategy: PID 22374 died... 16:25:55.076533 run iperf3-srv_10.42.42.10(pid=22374): Terminated {rc=256} 16:25:55.122686 --- ParallelTerminationStrategy: PID 22377 died... 16:25:55.142232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22377): Terminated: ok {rc=0} 16:25:55.187946 --- ParallelTerminationStrategy: PID 22380 died... 16:25:55.207398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22380): Terminated: ok {rc=0} 16:25:55.253509 --- ParallelTerminationStrategy: PID 22383 died... 16:25:55.273135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22383): Terminated: ok {rc=0} 16:25:55.361169 bus /gobi_4: Setting Powered False 16:25:56.460178 bus /gobi_4: Setting Powered False 16:25:57.576661 bus /gobi_1: Setting Powered False 16:25:58.675152 bus /gobi_1: Setting Powered False 16:25:59.794242 bus /gobi_0: Setting Powered False 16:26:00.912555 bus /gobi_0: Setting Powered False 16:26:02.039421 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms ping.py ---------------------------------------------- 16:26:03.153213 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:03.164402 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:26:03.213171 tst ping.py: using LAC 22274 16:26:03.329691 tst ping.py: using RAC 89 16:26:03.445030 tst ping.py: using CellId 22274 16:26:03.560077 tst ping.py: using BVCI 22275 16:26:03.666533 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:03.677120 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:03.687549 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:03.697963 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:03.708220 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:03.718523 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:03.728909 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:03.739263 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:26:03.854159 tst ping.py:19: start network... 16:26:04.052071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:04.507960 run create_hlr_db(pid=22385): Launched 16:26:04.629305 bus /gobi_6: Setting Powered False 16:26:05.688610 run create_hlr_db(pid=22385): Terminated: ok {rc=0} 16:26:06.121141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22387): Launched 16:26:06.439812 run osmo-hlr_10.42.42.2(pid=22388): Launched 16:26:06.561634 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:07.113450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22390): Launched 16:26:07.432433 run osmo-stp_10.42.42.5(pid=22391): Launched 16:26:07.553975 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:26:08.102916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22393): Launched 16:26:08.225302 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:26:08.493887 run patchelf(pid=22394): Launched 16:26:08.673695 run osmo-stp_10.42.42.5(pid=22391): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22391)] 16:26:08.809448 run osmo-stp_10.42.42.5(pid=22391): stdout: | (launched: 2022-12-09_16:26:07.374343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:08.946720 run osmo-stp_10.42.42.5(pid=22391): stderr: | [0;m[38;5;43m20221209162607566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162607567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162607567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162607567 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162607570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162607570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162607570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:09.084009 run osmo-stp_10.42.42.5(pid=22391): stdout: | (launched: 2022-12-09_16:26:07.374343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:09.215241 run osmo-stp_10.42.42.5(pid=22391): stderr: | [0;m[38;5;43m20221209162607566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162607567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162607567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162607567 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162607570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162607570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162607570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:09.370329 run patchelf(pid=22394): Terminating (SIGINT) 16:26:09.548193 run patchelf(pid=22394): Terminated: ok {rc=0} 16:26:09.677195 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22391): Process ended prematurely: osmo-stp_10.42.42.5(pid=22391) [trial-2361↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22391)] [trial-2361↪gprs:trx-lms↪ping.py:22] 16:26:09.686954 tst ping.py:22: Test FAILED (6.5 sec) 16:26:09.716110 run osmo-hlr_10.42.42.2(pid=22388): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22388)] 16:26:09.766492 run osmo-hlr_10.42.42.2(pid=22388): stdout: | (launched: 2022-12-09_16:26:06.382223) 16:26:09.818724 run osmo-hlr_10.42.42.2(pid=22388): stderr: | [0;m[1;31m20221209162606579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162606579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162606579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162606579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162606579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162606580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162606591 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162606599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162606600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162606600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:09.871796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22387): Terminating (SIGTERM) 16:26:09.914197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22390): Terminating (SIGTERM) 16:26:09.956890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22393): Terminating (SIGTERM) 16:26:09.999315 --- ParallelTerminationStrategy: PID 22387 died... 16:26:10.019557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22387): Terminated: ok {rc=0} 16:26:10.066503 --- ParallelTerminationStrategy: PID 22390 died... 16:26:10.086335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22390): Terminated: ok {rc=0} 16:26:10.133263 --- ParallelTerminationStrategy: PID 22393 died... 16:26:10.152703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22393): Terminated: ok {rc=0} 16:26:10.242618 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 16:26:11.330474 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:11.342766 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:26:11.394823 tst ping_idle_ping.py: using LAC 22275 16:26:11.520596 tst ping_idle_ping.py: using RAC 90 16:26:11.644325 tst ping_idle_ping.py: using CellId 22275 16:26:11.767862 tst ping_idle_ping.py: using BVCI 22276 16:26:11.883209 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:11.894259 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:11.905160 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:11.916252 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:11.927315 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:11.938804 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:11.950017 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:26:11.961243 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:26:12.076013 tst ping_idle_ping.py:24: start network... 16:26:12.287658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:12.747712 run create_hlr_db(pid=22395): Launched 16:26:12.870114 bus /gobi_6: Setting Powered False 16:26:13.929772 run create_hlr_db(pid=22395): Terminated: ok {rc=0} 16:26:14.366641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22397): Launched 16:26:14.687975 run osmo-hlr_10.42.42.2(pid=22398): Launched 16:26:14.811606 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:15.362413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22400): Launched 16:26:15.681254 run osmo-stp_10.42.42.5(pid=22401): Launched 16:26:15.803258 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:26:16.486814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22403): Launched 16:26:16.616309 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:26:16.875077 run patchelf(pid=22404): Launched 16:26:17.060749 run osmo-stp_10.42.42.5(pid=22401): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22401)] 16:26:17.190482 run osmo-stp_10.42.42.5(pid=22401): stdout: | (launched: 2022-12-09_16:26:15.622757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:17.319933 run osmo-stp_10.42.42.5(pid=22401): stderr: | [0;m[38;5;43m20221209162615813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162615814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162615814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162615814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162615815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162615815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162615815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:17.447878 run osmo-stp_10.42.42.5(pid=22401): stdout: | (launched: 2022-12-09_16:26:15.622757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:17.569884 run osmo-stp_10.42.42.5(pid=22401): stderr: | [0;m[38;5;43m20221209162615813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162615814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162615814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162615814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162615815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162615815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162615815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:17.714601 run patchelf(pid=22404): Terminating (SIGINT) 16:26:17.880767 run patchelf(pid=22404): Terminated: ok {rc=0} 16:26:18.001066 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22401): Process ended prematurely: osmo-stp_10.42.42.5(pid=22401) [trial-2361↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22401)] [trial-2361↪gprs:trx-lms↪ping_idle_ping.py:27] 16:26:18.009988 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:26:18.036594 run osmo-hlr_10.42.42.2(pid=22398): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22398)] 16:26:18.084515 run osmo-hlr_10.42.42.2(pid=22398): stdout: | (launched: 2022-12-09_16:26:14.629396) 16:26:18.133627 run osmo-hlr_10.42.42.2(pid=22398): stderr: | [0;m[1;31m20221209162614830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162614830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162614830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162614830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162614830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162614830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162614842 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162614850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162614850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162614850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:18.182997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22397): Terminating (SIGTERM) 16:26:18.222357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22400): Terminating (SIGTERM) 16:26:18.261687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22403): Terminating (SIGTERM) 16:26:18.301317 --- ParallelTerminationStrategy: PID 22397 died... 16:26:18.320160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22397): Terminated: ok {rc=0} 16:26:18.363767 --- ParallelTerminationStrategy: PID 22400 died... 16:26:18.382236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22400): Terminated: ok {rc=0} 16:26:18.426284 --- ParallelTerminationStrategy: PID 22403 died... 16:26:18.444750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22403): Terminated: ok {rc=0} 16:26:18.527918 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 16:26:19.823019 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:26:19.828123 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:26:19.860702 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:26:19.899166 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:26:19.987973 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:26:20.023266 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:26:20.063818 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:26:20.650112 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:26:20.699468 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:20.710342 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:26:20.760805 tst cs_paging_gprs_active.py: using LAC 22276 16:26:20.879606 tst cs_paging_gprs_active.py: using RAC 91 16:26:20.999615 tst cs_paging_gprs_active.py: using CellId 22276 16:26:21.119579 tst cs_paging_gprs_active.py: using BVCI 22277 16:26:21.228838 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:21.239809 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:21.250545 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:21.261283 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:21.271843 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:21.282466 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:21.293240 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:21.303716 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:21.314500 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:21.433672 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:21.554201 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:26:21.774833 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:26:22.101681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22409): Launched 16:26:22.385993 run iperf3-srv_10.42.42.10(pid=22410): Launched 16:26:22.509164 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:26:22.728001 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:26:23.053979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22411): Launched 16:26:23.338150 run iperf3-srv_10.42.42.10(pid=22412): Launched 16:26:23.462698 tst cs_paging_gprs_active.py:38: start network... 16:26:23.682693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:24.183221 run create_hlr_db(pid=22413): Launched 16:26:24.309313 bus /gobi_6: Setting Powered False 16:26:25.373591 run create_hlr_db(pid=22413): Terminated: ok {rc=0} 16:26:25.824155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22415): Launched 16:26:26.148910 run osmo-hlr_10.42.42.2(pid=22416): Launched 16:26:26.273322 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:26.832843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22418): Launched 16:26:27.156677 run osmo-stp_10.42.42.5(pid=22419): Launched 16:26:27.282017 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:26:27.840777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22421): Launched 16:26:27.965179 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:26:28.238945 run patchelf(pid=22422): Launched 16:26:28.422318 run osmo-stp_10.42.42.5(pid=22419): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22419)] 16:26:28.560120 run osmo-stp_10.42.42.5(pid=22419): stdout: | (launched: 2022-12-09_16:26:27.097942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:28.699969 run osmo-stp_10.42.42.5(pid=22419): stderr: | [0;m[38;5;43m20221209162627289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162627289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162627289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162627290 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162627290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162627290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162627290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:28.839435 run osmo-stp_10.42.42.5(pid=22419): stdout: | (launched: 2022-12-09_16:26:27.097942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:28.972383 run osmo-stp_10.42.42.5(pid=22419): stderr: | [0;m[38;5;43m20221209162627289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162627289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162627289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162627290 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162627290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162627290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162627290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:29.130224 run patchelf(pid=22422): Terminating (SIGINT) 16:26:29.312445 run patchelf(pid=22422): Terminated: ok {rc=0} 16:26:29.444039 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22419): Process ended prematurely: osmo-stp_10.42.42.5(pid=22419) [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22419)] [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:26:29.454294 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 16:26:29.483051 run osmo-hlr_10.42.42.2(pid=22416): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22416)] 16:26:29.532832 run osmo-hlr_10.42.42.2(pid=22416): stdout: | (launched: 2022-12-09_16:26:26.089978) 16:26:29.584141 run osmo-hlr_10.42.42.2(pid=22416): stderr: | [0;m[1;31m20221209162626288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162626288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162626288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162626288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162626288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162626288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162626300 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162626308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162626309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162626309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:29.635931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22409): Terminating (SIGTERM) 16:26:29.677793 run iperf3-srv_10.42.42.10(pid=22410): Terminating (SIGTERM) 16:26:29.719233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22411): Terminating (SIGTERM) 16:26:29.760757 run iperf3-srv_10.42.42.10(pid=22412): Terminating (SIGTERM) 16:26:29.802308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22415): Terminating (SIGTERM) 16:26:29.843710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22418): Terminating (SIGTERM) 16:26:29.885267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22421): Terminating (SIGTERM) 16:26:29.926976 --- ParallelTerminationStrategy: PID 22409 died... 16:26:29.946837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22409): Terminated: ok {rc=0} 16:26:29.993130 --- ParallelTerminationStrategy: PID 22410 died... 16:26:30.012372 run iperf3-srv_10.42.42.10(pid=22410): Terminated {rc=256} 16:26:30.058285 --- ParallelTerminationStrategy: PID 22411 died... 16:26:30.077593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22411): Terminated: ok {rc=0} 16:26:30.123427 --- ParallelTerminationStrategy: PID 22412 died... 16:26:30.142613 run iperf3-srv_10.42.42.10(pid=22412): Terminated {rc=256} 16:26:30.188297 --- ParallelTerminationStrategy: PID 22415 died... 16:26:30.207499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22415): Terminated: ok {rc=0} 16:26:30.253364 --- ParallelTerminationStrategy: PID 22418 died... 16:26:30.272579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22418): Terminated: ok {rc=0} 16:26:30.318359 --- ParallelTerminationStrategy: PID 22421 died... 16:26:30.337542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22421): Terminated: ok {rc=0} 16:26:30.424165 bus /gobi_0: Setting Powered False 16:26:31.528144 bus /gobi_0: Setting Powered False 16:26:32.659217 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:26:33.806924 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:33.818883 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:26:33.870739 tst iperf3.py: using LAC 22277 16:26:33.998766 tst iperf3.py: using RAC 92 16:26:34.127943 tst iperf3.py: using CellId 22277 16:26:34.254561 tst iperf3.py: using BVCI 22278 16:26:34.373889 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:34.385506 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:34.396572 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:34.408090 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:34.419538 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:34.430892 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:34.442460 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:34.453744 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:34.465322 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:34.587524 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:26:34.791130 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:26:35.094575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22423): Launched 16:26:35.357436 run iperf3-srv_10.42.42.10(pid=22424): Launched 16:26:35.469832 tst iperf3.py:8: start network... 16:26:35.672230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:36.134727 run create_hlr_db(pid=22425): Launched 16:26:36.257833 bus /gobi_6: Setting Powered False 16:26:37.318332 run create_hlr_db(pid=22425): Terminated: ok {rc=0} 16:26:37.740504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22427): Launched 16:26:38.043386 run osmo-hlr_10.42.42.2(pid=22428): Launched 16:26:38.158114 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:38.692139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22430): Launched 16:26:38.994843 run osmo-stp_10.42.42.5(pid=22431): Launched 16:26:39.109621 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:26:39.629076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22433): Launched 16:26:39.744873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:26:40.006049 run patchelf(pid=22434): Launched 16:26:40.187556 run osmo-stp_10.42.42.5(pid=22431): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22431)] 16:26:40.325276 run osmo-stp_10.42.42.5(pid=22431): stdout: | (launched: 2022-12-09_16:26:38.939608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:40.464041 run osmo-stp_10.42.42.5(pid=22431): stderr: | [0;m[38;5;43m20221209162639109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162639109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162639109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162639109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162639110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162639110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162639110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:40.603737 run osmo-stp_10.42.42.5(pid=22431): stdout: | (launched: 2022-12-09_16:26:38.939608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:40.736583 run osmo-stp_10.42.42.5(pid=22431): stderr: | [0;m[38;5;43m20221209162639109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162639109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162639109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162639109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162639110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162639110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162639110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:40.894330 run patchelf(pid=22434): Terminating (SIGINT) 16:26:41.076080 run patchelf(pid=22434): Terminated: ok {rc=0} 16:26:41.207598 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22431): Process ended prematurely: osmo-stp_10.42.42.5(pid=22431) [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22431)] [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 16:26:41.217694 tst iperf3.py:8: Test FAILED (7.4 sec) 16:26:41.246570 run osmo-hlr_10.42.42.2(pid=22428): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22428)] 16:26:41.296658 run osmo-hlr_10.42.42.2(pid=22428): stdout: | (launched: 2022-12-09_16:26:37.988235) 16:26:41.348771 run osmo-hlr_10.42.42.2(pid=22428): stderr: | [0;m[1;31m20221209162638164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162638164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162638164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162638164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162638164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162638164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162638176 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162638186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162638187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162638187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:41.401284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22423): Terminating (SIGTERM) 16:26:41.442959 run iperf3-srv_10.42.42.10(pid=22424): Terminating (SIGTERM) 16:26:41.484806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22427): Terminating (SIGTERM) 16:26:41.526687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22430): Terminating (SIGTERM) 16:26:41.568508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22433): Terminating (SIGTERM) 16:26:41.610740 --- ParallelTerminationStrategy: PID 22423 died... 16:26:41.630663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22423): Terminated: ok {rc=0} 16:26:41.677869 --- ParallelTerminationStrategy: PID 22424 died... 16:26:41.697620 run iperf3-srv_10.42.42.10(pid=22424): Terminated {rc=256} 16:26:41.743881 --- ParallelTerminationStrategy: PID 22427 died... 16:26:41.763468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22427): Terminated: ok {rc=0} 16:26:41.809698 --- ParallelTerminationStrategy: PID 22430 died... 16:26:41.829264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22430): Terminated: ok {rc=0} 16:26:41.876288 --- ParallelTerminationStrategy: PID 22433 died... 16:26:41.896058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22433): Terminated: ok {rc=0} 16:26:41.984513 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:26:43.133450 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:43.145621 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:26:43.203412 tst iperf3m4.py: using LAC 22278 16:26:43.329358 tst iperf3m4.py: using RAC 93 16:26:43.455097 tst iperf3m4.py: using CellId 22278 16:26:43.574422 tst iperf3m4.py: using BVCI 22279 16:26:43.685947 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:43.697004 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:43.707924 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:43.718863 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:43.729431 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:43.740040 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:43.750855 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:43.761419 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:26:43.772183 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:43.890813 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:44.013267 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:44.130483 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:26:44.249416 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:26:44.454253 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:26:44.758639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22435): Launched 16:26:45.023574 run iperf3-srv_10.42.42.10(pid=22436): Launched 16:26:45.138026 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:26:45.341600 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:26:45.646389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22437): Launched 16:26:45.921857 run iperf3-srv_10.42.42.10(pid=22438): Launched 16:26:46.050590 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:26:46.278509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:26:46.617735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22439): Launched 16:26:46.920366 run iperf3-srv_10.42.42.10(pid=22440): Launched 16:26:47.060806 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:26:47.284585 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:26:47.612070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22441): Launched 16:26:47.895373 run iperf3-srv_10.42.42.10(pid=22442): Launched 16:26:48.018747 tst iperf3m4.py:8: start network... 16:26:48.238687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:48.742091 run create_hlr_db(pid=22443): Launched 16:26:48.867195 bus /gobi_6: Setting Powered False 16:26:49.931115 run create_hlr_db(pid=22443): Terminated: ok {rc=0} 16:26:50.383528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22445): Launched 16:26:50.710779 run osmo-hlr_10.42.42.2(pid=22446): Launched 16:26:50.834625 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:51.395044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22448): Launched 16:26:51.721211 run osmo-stp_10.42.42.5(pid=22449): Launched 16:26:51.843330 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:26:52.399659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22451): Launched 16:26:52.525499 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:26:52.797941 run patchelf(pid=22452): Launched 16:26:52.979181 run osmo-stp_10.42.42.5(pid=22449): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22449)] 16:26:53.116331 run osmo-stp_10.42.42.5(pid=22449): stdout: | (launched: 2022-12-09_16:26:51.662209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:53.254871 run osmo-stp_10.42.42.5(pid=22449): stderr: | [0;m[38;5;43m20221209162651851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162651851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162651852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162651852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162651853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162651853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162651853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:53.393531 run osmo-stp_10.42.42.5(pid=22449): stdout: | (launched: 2022-12-09_16:26:51.662209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:53.525194 run osmo-stp_10.42.42.5(pid=22449): stderr: | [0;m[38;5;43m20221209162651851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162651851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162651852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162651852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162651853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162651853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162651853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:53.682388 run patchelf(pid=22452): Terminating (SIGINT) 16:26:53.862930 run patchelf(pid=22452): Terminated: ok {rc=0} 16:26:53.993378 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22449): Process ended prematurely: osmo-stp_10.42.42.5(pid=22449) [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22449)] [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 16:26:54.003508 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:26:54.032693 run osmo-hlr_10.42.42.2(pid=22446): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22446)] 16:26:54.082239 run osmo-hlr_10.42.42.2(pid=22446): stdout: | (launched: 2022-12-09_16:26:50.651274) 16:26:54.133711 run osmo-hlr_10.42.42.2(pid=22446): stderr: | [0;m[1;31m20221209162650848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162650848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162650848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162650848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162650848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162650848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162650860 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162650868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162650869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162650869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:54.185524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22435): Terminating (SIGTERM) 16:26:54.226904 run iperf3-srv_10.42.42.10(pid=22436): Terminating (SIGTERM) 16:26:54.268286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22437): Terminating (SIGTERM) 16:26:54.310236 run iperf3-srv_10.42.42.10(pid=22438): Terminating (SIGTERM) 16:26:54.351776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22439): Terminating (SIGTERM) 16:26:54.393422 run iperf3-srv_10.42.42.10(pid=22440): Terminating (SIGTERM) 16:26:54.434847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22441): Terminating (SIGTERM) 16:26:54.476644 run iperf3-srv_10.42.42.10(pid=22442): Terminating (SIGTERM) 16:26:54.518068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22445): Terminating (SIGTERM) 16:26:54.559608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22448): Terminating (SIGTERM) 16:26:54.601045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22451): Terminating (SIGTERM) 16:26:54.642910 --- ParallelTerminationStrategy: PID 22435 died... 16:26:54.663052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22435): Terminated: ok {rc=0} 16:26:54.709644 --- ParallelTerminationStrategy: PID 22436 died... 16:26:54.728717 run iperf3-srv_10.42.42.10(pid=22436): Terminated {rc=256} 16:26:54.774761 --- ParallelTerminationStrategy: PID 22437 died... 16:26:54.794134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22437): Terminated: ok {rc=0} 16:26:54.840113 --- ParallelTerminationStrategy: PID 22438 died... 16:26:54.859272 run iperf3-srv_10.42.42.10(pid=22438): Terminated {rc=256} 16:26:54.905100 --- ParallelTerminationStrategy: PID 22439 died... 16:26:54.924335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22439): Terminated: ok {rc=0} 16:26:54.970137 --- ParallelTerminationStrategy: PID 22440 died... 16:26:54.989343 run iperf3-srv_10.42.42.10(pid=22440): Terminated {rc=256} 16:26:55.034828 --- ParallelTerminationStrategy: PID 22441 died... 16:26:55.054515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22441): Terminated: ok {rc=0} 16:26:55.100489 --- ParallelTerminationStrategy: PID 22442 died... 16:26:55.119900 run iperf3-srv_10.42.42.10(pid=22442): Terminated {rc=256} 16:26:55.165541 --- ParallelTerminationStrategy: PID 22445 died... 16:26:55.184709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22445): Terminated: ok {rc=0} 16:26:55.230890 --- ParallelTerminationStrategy: PID 22448 died... 16:26:55.250233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22448): Terminated: ok {rc=0} 16:26:55.296247 --- ParallelTerminationStrategy: PID 22451 died... 16:26:55.315660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22451): Terminated: ok {rc=0} 16:26:55.404016 bus /gobi_4: Setting Powered False 16:26:56.501546 bus /gobi_4: Setting Powered False 16:26:57.614750 bus /gobi_1: Setting Powered False 16:26:58.712545 bus /gobi_1: Setting Powered False 16:26:59.827817 bus /gobi_0: Setting Powered False 16:27:00.923034 bus /gobi_0: Setting Powered False 16:27:02.058992 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 16:27:03.179203 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:03.191231 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:27:03.245774 tst ping.py: using LAC 22279 16:27:03.370764 tst ping.py: using RAC 94 16:27:03.494054 tst ping.py: using CellId 22279 16:27:03.617621 tst ping.py: using BVCI 22280 16:27:03.726222 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:03.737298 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:03.748200 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:03.759701 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:03.772594 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:03.784790 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:03.796834 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:03.808313 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:27:03.927096 tst ping.py:19: start network... 16:27:04.142502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:04.632553 run create_hlr_db(pid=22453): Launched 16:27:04.754300 bus /gobi_6: Setting Powered False 16:27:05.816936 run create_hlr_db(pid=22453): Terminated: ok {rc=0} 16:27:06.258154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22455): Launched 16:27:06.575825 run osmo-hlr_10.42.42.2(pid=22456): Launched 16:27:06.698336 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:07.226100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22458): Launched 16:27:07.522382 run osmo-stp_10.42.42.5(pid=22459): Launched 16:27:07.635052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:27:08.143357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22461): Launched 16:27:08.256544 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:27:08.506987 run patchelf(pid=22462): Launched 16:27:08.671857 run osmo-stp_10.42.42.5(pid=22459): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22459)] 16:27:08.797213 run osmo-stp_10.42.42.5(pid=22459): stdout: | (launched: 2022-12-09_16:27:07.467444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:08.924577 run osmo-stp_10.42.42.5(pid=22459): stderr: | [0;m[38;5;43m20221209162707637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162707637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162707638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162707638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162707638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162707638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162707639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:09.052097 run osmo-stp_10.42.42.5(pid=22459): stdout: | (launched: 2022-12-09_16:27:07.467444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:09.174320 run osmo-stp_10.42.42.5(pid=22459): stderr: | [0;m[38;5;43m20221209162707637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162707637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162707638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162707638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162707638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162707638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162707639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:09.318138 run patchelf(pid=22462): Terminating (SIGINT) 16:27:09.483792 run patchelf(pid=22462): Terminated: ok {rc=0} 16:27:09.603560 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22459): Process ended prematurely: osmo-stp_10.42.42.5(pid=22459) [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22459)] [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 16:27:09.612416 tst ping.py:22: Test FAILED (6.4 sec) 16:27:09.639395 run osmo-hlr_10.42.42.2(pid=22456): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22456)] 16:27:09.687333 run osmo-hlr_10.42.42.2(pid=22456): stdout: | (launched: 2022-12-09_16:27:06.518235) 16:27:09.736839 run osmo-hlr_10.42.42.2(pid=22456): stderr: | [0;m[1;31m20221209162706718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162706718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162706718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162706718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162706718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162706718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162706730 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162706740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162706740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162706740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:09.786822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22455): Terminating (SIGTERM) 16:27:09.827127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22458): Terminating (SIGTERM) 16:27:09.867263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22461): Terminating (SIGTERM) 16:27:09.907959 --- ParallelTerminationStrategy: PID 22455 died... 16:27:09.927246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22455): Terminated: ok {rc=0} 16:27:09.971714 --- ParallelTerminationStrategy: PID 22458 died... 16:27:09.990419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22458): Terminated: ok {rc=0} 16:27:10.034262 --- ParallelTerminationStrategy: PID 22461 died... 16:27:10.053023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22461): Terminated: ok {rc=0} 16:27:10.137068 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:27:11.223317 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:11.235600 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:27:11.288905 tst ping_idle_ping.py: using LAC 22280 16:27:11.414793 tst ping_idle_ping.py: using RAC 95 16:27:11.539765 tst ping_idle_ping.py: using CellId 22280 16:27:11.671039 tst ping_idle_ping.py: using BVCI 22281 16:27:11.787694 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:11.799127 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:11.810302 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:11.821896 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:11.833318 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:11.844804 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:11.856764 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:27:11.868821 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:27:11.986918 tst ping_idle_ping.py:24: start network... 16:27:12.187458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:12.650635 run create_hlr_db(pid=22463): Launched 16:27:12.772927 bus /gobi_6: Setting Powered False 16:27:13.833438 run create_hlr_db(pid=22463): Terminated: ok {rc=0} 16:27:14.250229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22465): Launched 16:27:14.547617 run osmo-hlr_10.42.42.2(pid=22466): Launched 16:27:14.660794 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:15.169384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22468): Launched 16:27:15.466468 run osmo-stp_10.42.42.5(pid=22469): Launched 16:27:15.580018 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:27:16.116183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22471): Launched 16:27:16.255925 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:27:16.545622 run patchelf(pid=22472): Launched 16:27:16.741384 run osmo-stp_10.42.42.5(pid=22469): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22469)] 16:27:16.882238 run osmo-stp_10.42.42.5(pid=22469): stdout: | (launched: 2022-12-09_16:27:15.411800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:17.026283 run osmo-stp_10.42.42.5(pid=22469): stderr: | [0;m[38;5;43m20221209162715583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162715583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162715583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162715584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162715584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162715584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162715584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:17.167790 run osmo-stp_10.42.42.5(pid=22469): stdout: | (launched: 2022-12-09_16:27:15.411800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:17.299681 run osmo-stp_10.42.42.5(pid=22469): stderr: | [0;m[38;5;43m20221209162715583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162715583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162715583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162715584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162715584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162715584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162715584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:17.455076 run patchelf(pid=22472): Terminating (SIGINT) 16:27:17.634704 run patchelf(pid=22472): Terminated: ok {rc=0} 16:27:17.763993 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22469): Process ended prematurely: osmo-stp_10.42.42.5(pid=22469) [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22469)] [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 16:27:17.773528 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:27:17.802258 run osmo-hlr_10.42.42.2(pid=22466): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22466)] 16:27:17.853532 run osmo-hlr_10.42.42.2(pid=22466): stdout: | (launched: 2022-12-09_16:27:14.493095) 16:27:17.905719 run osmo-hlr_10.42.42.2(pid=22466): stderr: | [0;m[1;31m20221209162714669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162714669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162714669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162714669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162714669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162714669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162714686 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162714695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162714695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162714695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:17.958333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22465): Terminating (SIGTERM) 16:27:18.000408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22468): Terminating (SIGTERM) 16:27:18.042582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22471): Terminating (SIGTERM) 16:27:18.085224 --- ParallelTerminationStrategy: PID 22465 died... 16:27:18.105152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22465): Terminated: ok {rc=0} 16:27:18.151413 --- ParallelTerminationStrategy: PID 22468 died... 16:27:18.170745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22468): Terminated: ok {rc=0} 16:27:18.217207 --- ParallelTerminationStrategy: PID 22471 died... 16:27:18.236543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22471): Terminated: ok {rc=0} 16:27:18.325291 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:27:19.633435 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:27:19.639981 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:27:19.676856 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:27:19.716213 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:27:19.802705 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:27:19.835745 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:27:19.873970 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:27:20.468150 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:27:20.517167 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:20.528103 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:27:20.597439 tst cs_paging_gprs_active.py: using LAC 22281 16:27:20.716268 tst cs_paging_gprs_active.py: using RAC 96 16:27:20.834545 tst cs_paging_gprs_active.py: using CellId 22281 16:27:20.953380 tst cs_paging_gprs_active.py: using BVCI 22282 16:27:21.067980 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:21.079131 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:21.089851 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:21.100728 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:21.111537 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:21.122432 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:21.133344 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:21.144007 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:21.154916 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:21.274174 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:21.394330 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:27:21.616047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:21.943281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22476): Launched 16:27:22.227332 run iperf3-srv_10.42.42.10(pid=22477): Launched 16:27:22.350934 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:27:22.569931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:22.896696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22478): Launched 16:27:23.180624 run iperf3-srv_10.42.42.10(pid=22479): Launched 16:27:23.304514 tst cs_paging_gprs_active.py:38: start network... 16:27:23.522705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:24.024307 run create_hlr_db(pid=22480): Launched 16:27:24.148272 bus /gobi_6: Setting Powered False 16:27:25.212855 run create_hlr_db(pid=22480): Terminated: ok {rc=0} 16:27:25.663897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22482): Launched 16:27:25.988233 run osmo-hlr_10.42.42.2(pid=22483): Launched 16:27:26.113466 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:26.671982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22485): Launched 16:27:26.996237 run osmo-stp_10.42.42.5(pid=22486): Launched 16:27:27.120182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:27:27.677713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22488): Launched 16:27:27.803460 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:27:28.084032 run patchelf(pid=22489): Launched 16:27:28.267729 run osmo-stp_10.42.42.5(pid=22486): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22486)] 16:27:28.406045 run osmo-stp_10.42.42.5(pid=22486): stdout: | (launched: 2022-12-09_16:27:26.937229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:28.545357 run osmo-stp_10.42.42.5(pid=22486): stderr: | [0;m[38;5;43m20221209162727128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162727128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162727128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162727129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162727129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162727129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162727129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:28.685290 run osmo-stp_10.42.42.5(pid=22486): stdout: | (launched: 2022-12-09_16:27:26.937229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:28.818477 run osmo-stp_10.42.42.5(pid=22486): stderr: | [0;m[38;5;43m20221209162727128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162727128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162727128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162727129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162727129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162727129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162727129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:28.976087 run patchelf(pid=22489): Terminating (SIGINT) 16:27:29.159197 run patchelf(pid=22489): Terminated: ok {rc=0} 16:27:29.291157 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22486): Process ended prematurely: osmo-stp_10.42.42.5(pid=22486) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22486)] [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:27:29.301333 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 16:27:29.330854 run osmo-hlr_10.42.42.2(pid=22483): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22483)] 16:27:29.381403 run osmo-hlr_10.42.42.2(pid=22483): stdout: | (launched: 2022-12-09_16:27:25.929369) 16:27:29.433527 run osmo-hlr_10.42.42.2(pid=22483): stderr: | [0;m[1;31m20221209162726124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162726124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162726124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162726124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162726124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162726124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162726136 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162726145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162726145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162726145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:29.485896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22476): Terminating (SIGTERM) 16:27:29.527906 run iperf3-srv_10.42.42.10(pid=22477): Terminating (SIGTERM) 16:27:29.570123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22478): Terminating (SIGTERM) 16:27:29.612416 run iperf3-srv_10.42.42.10(pid=22479): Terminating (SIGTERM) 16:27:29.654609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22482): Terminating (SIGTERM) 16:27:29.697827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22485): Terminating (SIGTERM) 16:27:29.739932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22488): Terminating (SIGTERM) 16:27:29.782246 --- ParallelTerminationStrategy: PID 22476 died... 16:27:29.802214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22476): Terminated: ok {rc=0} 16:27:29.849004 --- ParallelTerminationStrategy: PID 22477 died... 16:27:29.868652 run iperf3-srv_10.42.42.10(pid=22477): Terminated {rc=256} 16:27:29.915042 --- ParallelTerminationStrategy: PID 22478 died... 16:27:29.934783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22478): Terminated: ok {rc=0} 16:27:29.981354 --- ParallelTerminationStrategy: PID 22479 died... 16:27:30.001079 run iperf3-srv_10.42.42.10(pid=22479): Terminated {rc=256} 16:27:30.047601 --- ParallelTerminationStrategy: PID 22482 died... 16:27:30.067286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22482): Terminated: ok {rc=0} 16:27:30.113648 --- ParallelTerminationStrategy: PID 22485 died... 16:27:30.133322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22485): Terminated: ok {rc=0} 16:27:30.179748 --- ParallelTerminationStrategy: PID 22488 died... 16:27:30.199393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22488): Terminated: ok {rc=0} 16:27:30.286346 bus /gobi_0: Setting Powered False 16:27:31.390060 bus /gobi_0: Setting Powered False 16:27:32.518210 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:27:33.664531 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:33.676325 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:27:33.745937 tst iperf3.py: using LAC 22282 16:27:33.865557 tst iperf3.py: using RAC 97 16:27:33.985457 tst iperf3.py: using CellId 22282 16:27:34.104336 tst iperf3.py: using BVCI 22283 16:27:34.215313 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:34.226291 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:34.236930 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:34.247982 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:34.258886 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:34.269802 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:34.280677 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:34.291458 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:34.302430 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:34.417557 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:27:34.622832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:34.927549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22490): Launched 16:27:35.192667 run iperf3-srv_10.42.42.10(pid=22491): Launched 16:27:35.306312 tst iperf3.py:8: start network... 16:27:35.510082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:35.988752 run create_hlr_db(pid=22494): Launched 16:27:36.114155 bus /gobi_6: Setting Powered False 16:27:37.176648 run create_hlr_db(pid=22494): Terminated: ok {rc=0} 16:27:37.608280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22496): Launched 16:27:37.911632 run osmo-hlr_10.42.42.2(pid=22497): Launched 16:27:38.026268 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:38.543885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22499): Launched 16:27:38.846868 run osmo-stp_10.42.42.5(pid=22500): Launched 16:27:38.961737 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:27:39.481270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22502): Launched 16:27:39.597310 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:27:39.852271 run patchelf(pid=22503): Launched 16:27:40.021577 run osmo-stp_10.42.42.5(pid=22500): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22500)] 16:27:40.150237 run osmo-stp_10.42.42.5(pid=22500): stdout: | (launched: 2022-12-09_16:27:38.791498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:40.280517 run osmo-stp_10.42.42.5(pid=22500): stderr: | [0;m[38;5;43m20221209162738962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162738963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162738963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162738963 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162738964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162738964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162738964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:40.410628 run osmo-stp_10.42.42.5(pid=22500): stdout: | (launched: 2022-12-09_16:27:38.791498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:40.534127 run osmo-stp_10.42.42.5(pid=22500): stderr: | [0;m[38;5;43m20221209162738962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162738963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162738963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162738963 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162738964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162738964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162738964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:40.681110 run patchelf(pid=22503): Terminating (SIGINT) 16:27:40.851012 run patchelf(pid=22503): Terminated: ok {rc=0} 16:27:40.973302 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22500): Process ended prematurely: osmo-stp_10.42.42.5(pid=22500) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22500)] [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 16:27:40.982691 tst iperf3.py:8: Test FAILED (7.4 sec) 16:27:41.009884 run osmo-hlr_10.42.42.2(pid=22497): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22497)] 16:27:41.057279 run osmo-hlr_10.42.42.2(pid=22497): stdout: | (launched: 2022-12-09_16:27:37.855960) 16:27:41.106386 run osmo-hlr_10.42.42.2(pid=22497): stderr: | [0;m[1;31m20221209162738034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162738034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162738034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162738034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162738034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162738034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162738045 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162738054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162738054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162738054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:41.156107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22490): Terminating (SIGTERM) 16:27:41.195897 run iperf3-srv_10.42.42.10(pid=22491): Terminating (SIGTERM) 16:27:41.235536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22496): Terminating (SIGTERM) 16:27:41.275296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22499): Terminating (SIGTERM) 16:27:41.314879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22502): Terminating (SIGTERM) 16:27:41.354471 --- ParallelTerminationStrategy: PID 22490 died... 16:27:41.373315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22490): Terminated: ok {rc=0} 16:27:41.417513 --- ParallelTerminationStrategy: PID 22491 died... 16:27:41.436267 run iperf3-srv_10.42.42.10(pid=22491): Terminated {rc=256} 16:27:41.479658 --- ParallelTerminationStrategy: PID 22496 died... 16:27:41.498327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22496): Terminated: ok {rc=0} 16:27:41.541911 --- ParallelTerminationStrategy: PID 22499 died... 16:27:41.560493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22499): Terminated: ok {rc=0} 16:27:41.604114 --- ParallelTerminationStrategy: PID 22502 died... 16:27:41.622899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22502): Terminated: ok {rc=0} 16:27:41.707104 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:27:42.855011 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:42.866889 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:27:42.940558 tst iperf3m4.py: using LAC 22283 16:27:43.067035 tst iperf3m4.py: using RAC 98 16:27:43.193860 tst iperf3m4.py: using CellId 22283 16:27:43.320695 tst iperf3m4.py: using BVCI 22284 16:27:43.438626 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:43.450347 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:43.461813 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:43.473723 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:43.485569 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:43.497470 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:43.509286 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:43.520702 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:27:43.532919 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:43.652715 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:43.771300 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:43.887300 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:27:44.009350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:27:44.213137 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:44.516850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22504): Launched 16:27:44.780638 run iperf3-srv_10.42.42.10(pid=22505): Launched 16:27:44.893953 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:27:45.096880 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:45.401250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22506): Launched 16:27:45.664272 run iperf3-srv_10.42.42.10(pid=22507): Launched 16:27:45.777446 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:27:45.993226 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:46.305796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22508): Launched 16:27:46.604469 run iperf3-srv_10.42.42.10(pid=22509): Launched 16:27:46.740372 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:27:46.947760 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:27:47.255340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22510): Launched 16:27:47.518959 run iperf3-srv_10.42.42.10(pid=22511): Launched 16:27:47.631818 tst iperf3m4.py:8: start network... 16:27:47.834283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:48.301259 run create_hlr_db(pid=22512): Launched 16:27:48.428227 bus /gobi_6: Setting Powered False 16:27:49.489679 run create_hlr_db(pid=22512): Terminated: ok {rc=0} 16:27:49.931659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22514): Launched 16:27:50.257327 run osmo-hlr_10.42.42.2(pid=22515): Launched 16:27:50.382850 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:50.941634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22517): Launched 16:27:51.265311 run osmo-stp_10.42.42.5(pid=22518): Launched 16:27:51.389852 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:27:51.952441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22520): Launched 16:27:52.077837 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:27:52.351631 run patchelf(pid=22521): Launched 16:27:52.531638 run osmo-stp_10.42.42.5(pid=22518): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22518)] 16:27:52.669200 run osmo-stp_10.42.42.5(pid=22518): stdout: | (launched: 2022-12-09_16:27:51.206567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:52.808394 run osmo-stp_10.42.42.5(pid=22518): stderr: | [0;m[38;5;43m20221209162751396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162751396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162751396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162751397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162751397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162751397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162751397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:52.947355 run osmo-stp_10.42.42.5(pid=22518): stdout: | (launched: 2022-12-09_16:27:51.206567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:53.079873 run osmo-stp_10.42.42.5(pid=22518): stderr: | [0;m[38;5;43m20221209162751396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162751396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162751396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162751397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162751397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162751397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162751397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:53.236272 run patchelf(pid=22521): Terminating (SIGINT) 16:27:53.417559 run patchelf(pid=22521): Terminated: ok {rc=0} 16:27:53.548638 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22518): Process ended prematurely: osmo-stp_10.42.42.5(pid=22518) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22518)] [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:27:53.558819 tst iperf3m4.py:8: Test FAILED (10.7 sec) 16:27:53.587999 run osmo-hlr_10.42.42.2(pid=22515): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22515)] 16:27:53.637789 run osmo-hlr_10.42.42.2(pid=22515): stdout: | (launched: 2022-12-09_16:27:50.198535) 16:27:53.689573 run osmo-hlr_10.42.42.2(pid=22515): stderr: | [0;m[1;31m20221209162750395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162750395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162750395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162750395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162750395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162750396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162750408 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162750416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162750416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162750416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:53.741704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22504): Terminating (SIGTERM) 16:27:53.783617 run iperf3-srv_10.42.42.10(pid=22505): Terminating (SIGTERM) 16:27:53.825514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22506): Terminating (SIGTERM) 16:27:53.867396 run iperf3-srv_10.42.42.10(pid=22507): Terminating (SIGTERM) 16:27:53.910619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22508): Terminating (SIGTERM) 16:27:53.952696 run iperf3-srv_10.42.42.10(pid=22509): Terminating (SIGTERM) 16:27:53.994440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22510): Terminating (SIGTERM) 16:27:54.036318 run iperf3-srv_10.42.42.10(pid=22511): Terminating (SIGTERM) 16:27:54.078085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22514): Terminating (SIGTERM) 16:27:54.119592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22517): Terminating (SIGTERM) 16:27:54.161291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22520): Terminating (SIGTERM) 16:27:54.203385 --- ParallelTerminationStrategy: PID 22504 died... 16:27:54.222951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22504): Terminated: ok {rc=0} 16:27:54.269713 --- ParallelTerminationStrategy: PID 22505 died... 16:27:54.289311 run iperf3-srv_10.42.42.10(pid=22505): Terminated {rc=256} 16:27:54.335858 --- ParallelTerminationStrategy: PID 22506 died... 16:27:54.355373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22506): Terminated: ok {rc=0} 16:27:54.401665 --- ParallelTerminationStrategy: PID 22507 died... 16:27:54.421034 run iperf3-srv_10.42.42.10(pid=22507): Terminated {rc=256} 16:27:54.467004 --- ParallelTerminationStrategy: PID 22508 died... 16:27:54.486450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22508): Terminated: ok {rc=0} 16:27:54.532651 --- ParallelTerminationStrategy: PID 22509 died... 16:27:54.552093 run iperf3-srv_10.42.42.10(pid=22509): Terminated {rc=256} 16:27:54.598150 --- ParallelTerminationStrategy: PID 22510 died... 16:27:54.617527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22510): Terminated: ok {rc=0} 16:27:54.663640 --- ParallelTerminationStrategy: PID 22511 died... 16:27:54.683111 run iperf3-srv_10.42.42.10(pid=22511): Terminated {rc=256} 16:27:54.729692 --- ParallelTerminationStrategy: PID 22514 died... 16:27:54.749280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22514): Terminated: ok {rc=0} 16:27:54.795554 --- ParallelTerminationStrategy: PID 22517 died... 16:27:54.815010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22517): Terminated: ok {rc=0} 16:27:54.861135 --- ParallelTerminationStrategy: PID 22520 died... 16:27:54.880605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22520): Terminated: ok {rc=0} 16:27:54.968536 bus /gobi_4: Setting Powered False 16:27:56.068480 bus /gobi_4: Setting Powered False 16:27:57.185775 bus /gobi_1: Setting Powered False 16:27:58.285720 bus /gobi_1: Setting Powered False 16:27:59.399745 bus /gobi_0: Setting Powered False 16:28:00.496634 bus /gobi_0: Setting Powered False 16:28:01.624918 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:28:02.743947 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:02.756077 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:28:02.827373 tst ping.py: using LAC 22284 16:28:02.950211 tst ping.py: using RAC 99 16:28:03.076330 tst ping.py: using CellId 22284 16:28:03.199779 tst ping.py: using BVCI 22285 16:28:03.314463 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:03.325888 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:03.337020 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:03.348429 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:03.359779 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:03.371221 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:03.382724 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:03.394036 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:28:03.511403 tst ping.py:19: start network... 16:28:03.712663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:04.171229 run create_hlr_db(pid=22522): Launched 16:28:04.293448 bus /gobi_6: Setting Powered False 16:28:05.353353 run create_hlr_db(pid=22522): Terminated: ok {rc=0} 16:28:05.788838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22524): Launched 16:28:06.109189 run osmo-hlr_10.42.42.2(pid=22525): Launched 16:28:06.232487 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:06.783842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22527): Launched 16:28:07.084532 run osmo-stp_10.42.42.5(pid=22528): Launched 16:28:07.197208 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:07.708027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22530): Launched 16:28:07.822174 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:08.073687 run patchelf(pid=22531): Launched 16:28:08.238261 run osmo-stp_10.42.42.5(pid=22528): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22528)] 16:28:08.362922 run osmo-stp_10.42.42.5(pid=22528): stdout: | (launched: 2022-12-09_16:28:07.030081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:08.489820 run osmo-stp_10.42.42.5(pid=22528): stderr: | [0;m[38;5;43m20221209162807200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162807200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162807200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162807200 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162807201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162807201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162807201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:08.617186 run osmo-stp_10.42.42.5(pid=22528): stdout: | (launched: 2022-12-09_16:28:07.030081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:08.737874 run osmo-stp_10.42.42.5(pid=22528): stderr: | [0;m[38;5;43m20221209162807200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162807200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162807200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162807200 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162807201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162807201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162807201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:08.881829 run patchelf(pid=22531): Terminating (SIGINT) 16:28:09.047011 run patchelf(pid=22531): Terminated: ok {rc=0} 16:28:09.166556 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22528): Process ended prematurely: osmo-stp_10.42.42.5(pid=22528) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22528)] [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 16:28:09.175338 tst ping.py:22: Test FAILED (6.4 sec) 16:28:09.202223 run osmo-hlr_10.42.42.2(pid=22525): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22525)] 16:28:09.249392 run osmo-hlr_10.42.42.2(pid=22525): stdout: | (launched: 2022-12-09_16:28:06.051093) 16:28:09.298358 run osmo-hlr_10.42.42.2(pid=22525): stderr: | [0;m[1;31m20221209162806247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162806247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162806247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162806247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162806247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162806247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162806259 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162806267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162806267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162806267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:09.347890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22524): Terminating (SIGTERM) 16:28:09.387638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22527): Terminating (SIGTERM) 16:28:09.427610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22530): Terminating (SIGTERM) 16:28:09.467727 --- ParallelTerminationStrategy: PID 22524 died... 16:28:09.486852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22524): Terminated: ok {rc=0} 16:28:09.531013 --- ParallelTerminationStrategy: PID 22527 died... 16:28:09.549714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22527): Terminated: ok {rc=0} 16:28:09.593496 --- ParallelTerminationStrategy: PID 22530 died... 16:28:09.612528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22530): Terminated: ok {rc=0} 16:28:09.699394 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:28:10.788351 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:10.800169 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:28:10.870601 tst ping_idle_ping.py: using LAC 22285 16:28:10.989330 tst ping_idle_ping.py: using RAC 100 16:28:11.105593 tst ping_idle_ping.py: using CellId 22285 16:28:11.221376 tst ping_idle_ping.py: using BVCI 22286 16:28:11.328790 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:11.340120 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:11.351150 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:11.362158 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:11.373135 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:11.384093 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:11.395117 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:28:11.406079 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:28:11.520599 tst ping_idle_ping.py:24: start network... 16:28:11.722964 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:12.187020 run create_hlr_db(pid=22532): Launched 16:28:12.309148 bus /gobi_6: Setting Powered False 16:28:13.369353 run create_hlr_db(pid=22532): Terminated: ok {rc=0} 16:28:13.807557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22535): Launched 16:28:14.126658 run osmo-hlr_10.42.42.2(pid=22536): Launched 16:28:14.250411 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:14.799922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22538): Launched 16:28:15.118691 run osmo-stp_10.42.42.5(pid=22539): Launched 16:28:15.242510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:15.794944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22541): Launched 16:28:15.937159 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:16.215423 run patchelf(pid=22542): Launched 16:28:16.408464 run osmo-stp_10.42.42.5(pid=22539): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22539)] 16:28:16.547270 run osmo-stp_10.42.42.5(pid=22539): stdout: | (launched: 2022-12-09_16:28:15.060548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:16.688164 run osmo-stp_10.42.42.5(pid=22539): stderr: | [0;m[38;5;43m20221209162815252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162815252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162815253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162815253 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162815253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162815253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162815254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:16.849817 run osmo-stp_10.42.42.5(pid=22539): stdout: | (launched: 2022-12-09_16:28:15.060548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:16.989122 run osmo-stp_10.42.42.5(pid=22539): stderr: | [0;m[38;5;43m20221209162815252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162815252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162815253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162815253 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162815253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162815253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162815254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:17.138408 run patchelf(pid=22542): Terminating (SIGINT) 16:28:17.319416 run patchelf(pid=22542): Terminated: ok {rc=0} 16:28:17.448565 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22539): Process ended prematurely: osmo-stp_10.42.42.5(pid=22539) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22539)] [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:28:17.458425 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:28:17.487416 run osmo-hlr_10.42.42.2(pid=22536): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22536)] 16:28:17.537669 run osmo-hlr_10.42.42.2(pid=22536): stdout: | (launched: 2022-12-09_16:28:14.068621) 16:28:17.590190 run osmo-hlr_10.42.42.2(pid=22536): stderr: | [0;m[1;31m20221209162814264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162814264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162814264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162814264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162814265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162814265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162814278 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162814286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162814286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162814286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:17.642566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22535): Terminating (SIGTERM) 16:28:17.684574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22538): Terminating (SIGTERM) 16:28:17.727009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22541): Terminating (SIGTERM) 16:28:17.769329 --- ParallelTerminationStrategy: PID 22535 died... 16:28:17.789633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22535): Terminated: ok {rc=0} 16:28:17.837143 --- ParallelTerminationStrategy: PID 22538 died... 16:28:17.857075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22538): Terminated: ok {rc=0} 16:28:17.904182 --- ParallelTerminationStrategy: PID 22541 died... 16:28:17.924122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22541): Terminated: ok {rc=0} 16:28:18.012185 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:28:19.320604 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:28:19.327692 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:28:19.362754 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:28:19.402533 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:28:19.491282 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:28:19.525172 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:28:19.564697 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:28:20.160915 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:28:20.213915 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:20.225257 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:28:20.296486 tst cs_paging_gprs_active.py: using LAC 22286 16:28:20.424572 tst cs_paging_gprs_active.py: using RAC 101 16:28:20.552584 tst cs_paging_gprs_active.py: using CellId 22286 16:28:20.679003 tst cs_paging_gprs_active.py: using BVCI 22287 16:28:20.797399 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:20.808857 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:20.820203 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:20.831787 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:20.843405 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:20.854987 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:20.866716 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:20.878216 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:20.889889 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:21.011500 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:21.137535 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:28:21.357643 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:21.683161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22547): Launched 16:28:21.968425 run iperf3-srv_10.42.42.10(pid=22548): Launched 16:28:22.091036 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:28:22.310117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:22.636193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22549): Launched 16:28:22.919905 run iperf3-srv_10.42.42.10(pid=22550): Launched 16:28:23.041848 tst cs_paging_gprs_active.py:38: start network... 16:28:23.261238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:23.764167 run create_hlr_db(pid=22551): Launched 16:28:23.889362 bus /gobi_6: Setting Powered False 16:28:24.953944 run create_hlr_db(pid=22551): Terminated: ok {rc=0} 16:28:25.387383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22553): Launched 16:28:25.690517 run osmo-hlr_10.42.42.2(pid=22554): Launched 16:28:25.806236 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:26.329206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22556): Launched 16:28:26.631382 run osmo-stp_10.42.42.5(pid=22557): Launched 16:28:26.747019 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:27.268538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22559): Launched 16:28:27.386756 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:27.643203 run patchelf(pid=22560): Launched 16:28:27.816112 run osmo-stp_10.42.42.5(pid=22557): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22557)] 16:28:27.944674 run osmo-stp_10.42.42.5(pid=22557): stdout: | (launched: 2022-12-09_16:28:26.575984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:28.074763 run osmo-stp_10.42.42.5(pid=22557): stderr: | [0;m[38;5;43m20221209162826748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162826748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162826748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162826749 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162826749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162826749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162826749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:28.204547 run osmo-stp_10.42.42.5(pid=22557): stdout: | (launched: 2022-12-09_16:28:26.575984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:28.328399 run osmo-stp_10.42.42.5(pid=22557): stderr: | [0;m[38;5;43m20221209162826748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162826748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162826748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162826749 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162826749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162826749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162826749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:28.475580 run patchelf(pid=22560): Terminating (SIGINT) 16:28:28.645586 run patchelf(pid=22560): Terminated: ok {rc=0} 16:28:28.768510 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22557): Process ended prematurely: osmo-stp_10.42.42.5(pid=22557) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22557)] [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:28:28.777968 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 16:28:28.805597 run osmo-hlr_10.42.42.2(pid=22554): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22554)] 16:28:28.853071 run osmo-hlr_10.42.42.2(pid=22554): stdout: | (launched: 2022-12-09_16:28:25.634474) 16:28:28.902109 run osmo-hlr_10.42.42.2(pid=22554): stderr: | [0;m[1;31m20221209162825812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162825812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162825812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162825812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162825812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162825812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162825825 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162825835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162825835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162825835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:28.951799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22547): Terminating (SIGTERM) 16:28:28.991378 run iperf3-srv_10.42.42.10(pid=22548): Terminating (SIGTERM) 16:28:29.030813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22549): Terminating (SIGTERM) 16:28:29.070256 run iperf3-srv_10.42.42.10(pid=22550): Terminating (SIGTERM) 16:28:29.109827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22553): Terminating (SIGTERM) 16:28:29.149407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22556): Terminating (SIGTERM) 16:28:29.188810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22559): Terminating (SIGTERM) 16:28:29.228571 --- ParallelTerminationStrategy: PID 22547 died... 16:28:29.247705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22547): Terminated: ok {rc=0} 16:28:29.291515 --- ParallelTerminationStrategy: PID 22548 died... 16:28:29.309997 run iperf3-srv_10.42.42.10(pid=22548): Terminated {rc=256} 16:28:29.353831 --- ParallelTerminationStrategy: PID 22549 died... 16:28:29.373631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22549): Terminated: ok {rc=0} 16:28:29.417270 --- ParallelTerminationStrategy: PID 22550 died... 16:28:29.435725 run iperf3-srv_10.42.42.10(pid=22550): Terminated {rc=256} 16:28:29.479424 --- ParallelTerminationStrategy: PID 22553 died... 16:28:29.497956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22553): Terminated: ok {rc=0} 16:28:29.541508 --- ParallelTerminationStrategy: PID 22556 died... 16:28:29.560089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22556): Terminated: ok {rc=0} 16:28:29.603702 --- ParallelTerminationStrategy: PID 22559 died... 16:28:29.622298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22559): Terminated: ok {rc=0} 16:28:29.707850 bus /gobi_0: Setting Powered False 16:28:30.806427 bus /gobi_0: Setting Powered False 16:28:31.920746 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:28:33.066008 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:33.077910 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:28:33.148564 tst iperf3.py: using LAC 22287 16:28:33.266285 tst iperf3.py: using RAC 102 16:28:33.385357 tst iperf3.py: using CellId 22287 16:28:33.507158 tst iperf3.py: using BVCI 22288 16:28:33.617642 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:33.628680 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:33.639740 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:33.650618 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:33.661493 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:33.672352 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:33.683426 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:33.694350 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:33.705406 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:33.820794 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:28:34.023378 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:34.325742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22561): Launched 16:28:34.588318 run iperf3-srv_10.42.42.10(pid=22562): Launched 16:28:34.703873 tst iperf3.py:8: start network... 16:28:34.906840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:35.373440 run create_hlr_db(pid=22563): Launched 16:28:35.496611 bus /gobi_6: Setting Powered False 16:28:36.556062 run create_hlr_db(pid=22563): Terminated: ok {rc=0} 16:28:36.998563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22565): Launched 16:28:37.324381 run osmo-hlr_10.42.42.2(pid=22566): Launched 16:28:37.449971 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:38.013256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22568): Launched 16:28:38.338199 run osmo-stp_10.42.42.5(pid=22569): Launched 16:28:38.462334 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:39.023591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22571): Launched 16:28:39.150246 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:39.425109 run patchelf(pid=22572): Launched 16:28:39.607818 run osmo-stp_10.42.42.5(pid=22569): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22569)] 16:28:39.747010 run osmo-stp_10.42.42.5(pid=22569): stdout: | (launched: 2022-12-09_16:28:38.279213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:39.887428 run osmo-stp_10.42.42.5(pid=22569): stderr: | [0;m[38;5;43m20221209162838471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162838471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162838472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162838472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162838473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162838473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162838473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:40.027707 run osmo-stp_10.42.42.5(pid=22569): stdout: | (launched: 2022-12-09_16:28:38.279213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:40.161205 run osmo-stp_10.42.42.5(pid=22569): stderr: | [0;m[38;5;43m20221209162838471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162838471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162838472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162838472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162838473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162838473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162838473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:40.319169 run patchelf(pid=22572): Terminating (SIGINT) 16:28:40.501068 run patchelf(pid=22572): Terminated: ok {rc=0} 16:28:40.632216 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22569): Process ended prematurely: osmo-stp_10.42.42.5(pid=22569) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22569)] [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 16:28:40.642302 tst iperf3.py:8: Test FAILED (7.6 sec) 16:28:40.671441 run osmo-hlr_10.42.42.2(pid=22566): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22566)] 16:28:40.722321 run osmo-hlr_10.42.42.2(pid=22566): stdout: | (launched: 2022-12-09_16:28:37.265139) 16:28:40.774774 run osmo-hlr_10.42.42.2(pid=22566): stderr: | [0;m[1;31m20221209162837462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162837462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162837462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162837462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162837462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162837462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162837478 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162837487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162837487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162837487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:40.827844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22561): Terminating (SIGTERM) 16:28:40.870130 run iperf3-srv_10.42.42.10(pid=22562): Terminating (SIGTERM) 16:28:40.912261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22565): Terminating (SIGTERM) 16:28:40.954574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22568): Terminating (SIGTERM) 16:28:40.996820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22571): Terminating (SIGTERM) 16:28:41.039512 --- ParallelTerminationStrategy: PID 22561 died... 16:28:41.059666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22561): Terminated: ok {rc=0} 16:28:41.106735 --- ParallelTerminationStrategy: PID 22562 died... 16:28:41.126359 run iperf3-srv_10.42.42.10(pid=22562): Terminated {rc=256} 16:28:41.172737 --- ParallelTerminationStrategy: PID 22565 died... 16:28:41.192495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22565): Terminated: ok {rc=0} 16:28:41.239040 --- ParallelTerminationStrategy: PID 22568 died... 16:28:41.258795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22568): Terminated: ok {rc=0} 16:28:41.305556 --- ParallelTerminationStrategy: PID 22571 died... 16:28:41.325189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22571): Terminated: ok {rc=0} 16:28:41.412499 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:28:42.561585 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:42.574005 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:28:42.647268 tst iperf3m4.py: using LAC 22288 16:28:42.774527 tst iperf3m4.py: using RAC 103 16:28:42.900367 tst iperf3m4.py: using CellId 22288 16:28:43.027791 tst iperf3m4.py: using BVCI 22289 16:28:43.146441 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:43.157936 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:43.169088 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:43.180430 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:43.191780 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:43.203128 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:43.214719 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:43.226189 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:28:43.237916 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:43.358611 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:43.479619 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:43.599529 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:28:43.718750 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:28:43.923467 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:44.227569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22573): Launched 16:28:44.492046 run iperf3-srv_10.42.42.10(pid=22574): Launched 16:28:44.606057 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:28:44.809719 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:45.114052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22575): Launched 16:28:45.377710 run iperf3-srv_10.42.42.10(pid=22576): Launched 16:28:45.490721 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:28:45.693059 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:46.036612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22577): Launched 16:28:46.338102 run iperf3-srv_10.42.42.10(pid=22578): Launched 16:28:46.490270 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:28:46.769239 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:47.144035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22579): Launched 16:28:47.432170 run iperf3-srv_10.42.42.10(pid=22580): Launched 16:28:47.557060 tst iperf3m4.py:8: start network... 16:28:47.776858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:48.277902 run create_hlr_db(pid=22581): Launched 16:28:48.403051 bus /gobi_6: Setting Powered False 16:28:49.466289 run create_hlr_db(pid=22581): Terminated: ok {rc=0} 16:28:49.916931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22583): Launched 16:28:50.240773 run osmo-hlr_10.42.42.2(pid=22584): Launched 16:28:50.365813 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:50.924546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22586): Launched 16:28:51.249721 run osmo-stp_10.42.42.5(pid=22587): Launched 16:28:51.374073 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:51.931280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22589): Launched 16:28:52.057467 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:52.330682 run patchelf(pid=22590): Launched 16:28:52.511469 run osmo-stp_10.42.42.5(pid=22587): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22587)] 16:28:52.649093 run osmo-stp_10.42.42.5(pid=22587): stdout: | (launched: 2022-12-09_16:28:51.190988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:52.788361 run osmo-stp_10.42.42.5(pid=22587): stderr: | [0;m[38;5;43m20221209162851382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162851382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162851382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162851383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162851383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162851383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162851383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:52.927733 run osmo-stp_10.42.42.5(pid=22587): stdout: | (launched: 2022-12-09_16:28:51.190988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:53.060611 run osmo-stp_10.42.42.5(pid=22587): stderr: | [0;m[38;5;43m20221209162851382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162851382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162851382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162851383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162851383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162851383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162851383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:53.217885 run patchelf(pid=22590): Terminating (SIGINT) 16:28:53.399211 run patchelf(pid=22590): Terminated: ok {rc=0} 16:28:53.530501 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22587): Process ended prematurely: osmo-stp_10.42.42.5(pid=22587) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22587)] [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:28:53.540918 tst iperf3m4.py:8: Test FAILED (11.0 sec) 16:28:53.570716 run osmo-hlr_10.42.42.2(pid=22584): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22584)] 16:28:53.621281 run osmo-hlr_10.42.42.2(pid=22584): stdout: | (launched: 2022-12-09_16:28:50.181913) 16:28:53.673569 run osmo-hlr_10.42.42.2(pid=22584): stderr: | [0;m[1;31m20221209162850381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162850381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162850381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162850382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162850382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162850382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162850394 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162850402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162850403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162850403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:53.726511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22573): Terminating (SIGTERM) 16:28:53.768761 run iperf3-srv_10.42.42.10(pid=22574): Terminating (SIGTERM) 16:28:53.810991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22575): Terminating (SIGTERM) 16:28:53.853303 run iperf3-srv_10.42.42.10(pid=22576): Terminating (SIGTERM) 16:28:53.895287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22577): Terminating (SIGTERM) 16:28:53.937454 run iperf3-srv_10.42.42.10(pid=22578): Terminating (SIGTERM) 16:28:53.980537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22579): Terminating (SIGTERM) 16:28:54.023218 run iperf3-srv_10.42.42.10(pid=22580): Terminating (SIGTERM) 16:28:54.062937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22583): Terminating (SIGTERM) 16:28:54.102647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22586): Terminating (SIGTERM) 16:28:54.142282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22589): Terminating (SIGTERM) 16:28:54.182542 --- ParallelTerminationStrategy: PID 22573 died... 16:28:54.201610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22573): Terminated: ok {rc=0} 16:28:54.246393 --- ParallelTerminationStrategy: PID 22574 died... 16:28:54.265203 run iperf3-srv_10.42.42.10(pid=22574): Terminated {rc=256} 16:28:54.309657 --- ParallelTerminationStrategy: PID 22575 died... 16:28:54.328258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22575): Terminated: ok {rc=0} 16:28:54.373026 --- ParallelTerminationStrategy: PID 22576 died... 16:28:54.391570 run iperf3-srv_10.42.42.10(pid=22576): Terminated {rc=256} 16:28:54.435959 --- ParallelTerminationStrategy: PID 22577 died... 16:28:54.454454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22577): Terminated: ok {rc=0} 16:28:54.499570 --- ParallelTerminationStrategy: PID 22578 died... 16:28:54.518241 run iperf3-srv_10.42.42.10(pid=22578): Terminated {rc=256} 16:28:54.562820 --- ParallelTerminationStrategy: PID 22579 died... 16:28:54.581416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22579): Terminated: ok {rc=0} 16:28:54.626071 --- ParallelTerminationStrategy: PID 22580 died... 16:28:54.644561 run iperf3-srv_10.42.42.10(pid=22580): Terminated {rc=256} 16:28:54.689068 --- ParallelTerminationStrategy: PID 22583 died... 16:28:54.707688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22583): Terminated: ok {rc=0} 16:28:54.752190 --- ParallelTerminationStrategy: PID 22586 died... 16:28:54.770839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22586): Terminated: ok {rc=0} 16:28:54.815939 --- ParallelTerminationStrategy: PID 22589 died... 16:28:54.834555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22589): Terminated: ok {rc=0} 16:28:54.922284 bus /gobi_4: Setting Powered False 16:28:56.025091 bus /gobi_4: Setting Powered False 16:28:57.141297 bus /gobi_1: Setting Powered False 16:28:58.239477 bus /gobi_1: Setting Powered False 16:28:59.355209 bus /gobi_0: Setting Powered False 16:29:00.452362 bus /gobi_0: Setting Powered False 16:29:01.577220 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:29:02.689693 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:02.701222 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:29:02.771720 tst ping.py: using LAC 22289 16:29:02.889360 tst ping.py: using RAC 104 16:29:03.005166 tst ping.py: using CellId 22289 16:29:03.120895 tst ping.py: using BVCI 22290 16:29:03.237994 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:03.249588 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:03.261075 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:03.273356 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:03.284810 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:03.296606 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:03.308510 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:03.320280 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:29:03.439180 tst ping.py:19: start network... 16:29:03.655614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:04.149405 run create_hlr_db(pid=22591): Launched 16:29:04.272520 bus /gobi_6: Setting Powered False 16:29:05.336065 run create_hlr_db(pid=22591): Terminated: ok {rc=0} 16:29:05.763404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22593): Launched 16:29:06.061572 run osmo-hlr_10.42.42.2(pid=22594): Launched 16:29:06.175200 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:06.687702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22596): Launched 16:29:06.985298 run osmo-stp_10.42.42.5(pid=22597): Launched 16:29:07.099684 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:07.615256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22599): Launched 16:29:07.729083 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:07.981073 run patchelf(pid=22600): Launched 16:29:08.147983 run osmo-stp_10.42.42.5(pid=22597): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22597)] 16:29:08.273914 run osmo-stp_10.42.42.5(pid=22597): stdout: | (launched: 2022-12-09_16:29:06.930397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:08.402128 run osmo-stp_10.42.42.5(pid=22597): stderr: | [0;m[38;5;43m20221209162907102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162907102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162907102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162907103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162907103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162907103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162907103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:08.530280 run osmo-stp_10.42.42.5(pid=22597): stdout: | (launched: 2022-12-09_16:29:06.930397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:08.652041 run osmo-stp_10.42.42.5(pid=22597): stderr: | [0;m[38;5;43m20221209162907102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162907102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162907102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162907103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162907103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162907103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162907103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:08.797122 run patchelf(pid=22600): Terminating (SIGINT) 16:29:08.963506 run patchelf(pid=22600): Terminated: ok {rc=0} 16:29:09.083525 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22597): Process ended prematurely: osmo-stp_10.42.42.5(pid=22597) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22597)] [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 16:29:09.092343 tst ping.py:22: Test FAILED (6.4 sec) 16:29:09.119370 run osmo-hlr_10.42.42.2(pid=22594): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22594)] 16:29:09.167216 run osmo-hlr_10.42.42.2(pid=22594): stdout: | (launched: 2022-12-09_16:29:06.007035) 16:29:09.216897 run osmo-hlr_10.42.42.2(pid=22594): stderr: | [0;m[1;31m20221209162906184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162906184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162906184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162906184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162906184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162906184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162906195 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162906203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162906203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162906203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:09.266967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22593): Terminating (SIGTERM) 16:29:09.306916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22596): Terminating (SIGTERM) 16:29:09.346873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22599): Terminating (SIGTERM) 16:29:09.387193 --- ParallelTerminationStrategy: PID 22593 died... 16:29:09.406335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22593): Terminated: ok {rc=0} 16:29:09.450830 --- ParallelTerminationStrategy: PID 22596 died... 16:29:09.469773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22596): Terminated: ok {rc=0} 16:29:09.513956 --- ParallelTerminationStrategy: PID 22599 died... 16:29:09.532571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22599): Terminated: ok {rc=0} 16:29:09.616572 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:29:10.701269 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:10.713273 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:29:10.785367 tst ping_idle_ping.py: using LAC 22290 16:29:10.912555 tst ping_idle_ping.py: using RAC 105 16:29:11.038463 tst ping_idle_ping.py: using CellId 22290 16:29:11.163449 tst ping_idle_ping.py: using BVCI 22291 16:29:11.280089 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:11.291712 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:11.303163 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:11.315399 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:11.327404 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:11.339576 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:11.351769 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:29:11.363865 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:29:11.484325 tst ping_idle_ping.py:24: start network... 16:29:11.701188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:12.200851 run create_hlr_db(pid=22601): Launched 16:29:12.325628 bus /gobi_6: Setting Powered False 16:29:13.389456 run create_hlr_db(pid=22601): Terminated: ok {rc=0} 16:29:13.818694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22603): Launched 16:29:14.119633 run osmo-hlr_10.42.42.2(pid=22604): Launched 16:29:14.234225 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:14.751207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22606): Launched 16:29:15.049258 run osmo-stp_10.42.42.5(pid=22607): Launched 16:29:15.163536 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:15.677551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22609): Launched 16:29:15.791336 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:16.067351 run patchelf(pid=22610): Launched 16:29:16.263638 run osmo-stp_10.42.42.5(pid=22607): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22607)] 16:29:16.404593 run osmo-stp_10.42.42.5(pid=22607): stdout: | (launched: 2022-12-09_16:29:14.994468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:16.545966 run osmo-stp_10.42.42.5(pid=22607): stderr: | [0;m[38;5;43m20221209162915164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162915164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162915165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162915165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162915166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162915166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162915166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:16.688697 run osmo-stp_10.42.42.5(pid=22607): stdout: | (launched: 2022-12-09_16:29:14.994468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:16.825046 run osmo-stp_10.42.42.5(pid=22607): stderr: | [0;m[38;5;43m20221209162915164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162915164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162915165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162915165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162915166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162915166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162915166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:16.990850 run patchelf(pid=22610): Terminating (SIGINT) 16:29:17.209497 run patchelf(pid=22610): Terminated: ok {rc=0} 16:29:17.341990 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22607): Process ended prematurely: osmo-stp_10.42.42.5(pid=22607) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22607)] [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:29:17.351916 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:29:17.381715 run osmo-hlr_10.42.42.2(pid=22604): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22604)] 16:29:17.432307 run osmo-hlr_10.42.42.2(pid=22604): stdout: | (launched: 2022-12-09_16:29:14.064405) 16:29:17.484584 run osmo-hlr_10.42.42.2(pid=22604): stderr: | [0;m[1;31m20221209162914241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162914241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162914241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162914241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162914241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162914241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162914255 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162914264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162914264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162914264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:17.537695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22603): Terminating (SIGTERM) 16:29:17.580613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22606): Terminating (SIGTERM) 16:29:17.623256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22609): Terminating (SIGTERM) 16:29:17.666165 --- ParallelTerminationStrategy: PID 22603 died... 16:29:17.686411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22603): Terminated: ok {rc=0} 16:29:17.733889 --- ParallelTerminationStrategy: PID 22606 died... 16:29:17.753808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22606): Terminated: ok {rc=0} 16:29:17.800366 --- ParallelTerminationStrategy: PID 22609 died... 16:29:17.820273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22609): Terminated: ok {rc=0} 16:29:17.909434 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:29:19.219224 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:29:19.226823 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:29:19.262261 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:29:19.297696 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:29:19.353746 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:29:19.388401 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:29:19.423933 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:29:19.977291 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:29:19.983249 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:19.995026 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:29:20.065210 tst switch_tch_pdch.py: using LAC 22291 16:29:20.182251 tst switch_tch_pdch.py: using RAC 106 16:29:20.309249 tst switch_tch_pdch.py: using CellId 22291 16:29:20.435378 tst switch_tch_pdch.py: using BVCI 22292 16:29:20.552623 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:20.566769 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:20.578920 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:20.591064 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:20.602146 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:20.613157 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:20.624395 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:29:20.635415 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:29:20.753961 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:29:20.879601 tst switch_tch_pdch.py:51: start network... 16:29:21.096880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:21.590521 run create_hlr_db(pid=22614): Launched 16:29:21.711799 bus /gobi_6: Setting Powered False 16:29:22.776258 run create_hlr_db(pid=22614): Terminated: ok {rc=0} 16:29:23.202597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22616): Launched 16:29:23.501530 run osmo-hlr_10.42.42.2(pid=22617): Launched 16:29:23.616155 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:24.131047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22619): Launched 16:29:24.429717 run osmo-stp_10.42.42.5(pid=22620): Launched 16:29:24.542717 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:25.054338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22622): Launched 16:29:25.167663 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:25.417646 run patchelf(pid=22623): Launched 16:29:25.582333 run osmo-stp_10.42.42.5(pid=22620): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22620)] 16:29:25.707656 run osmo-stp_10.42.42.5(pid=22620): stdout: | (launched: 2022-12-09_16:29:24.374970) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:25.834889 run osmo-stp_10.42.42.5(pid=22620): stderr: | [0;m[38;5;43m20221209162924543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162924543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162924543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162924544 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162924546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162924546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162924546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:25.961775 run osmo-stp_10.42.42.5(pid=22620): stdout: | (launched: 2022-12-09_16:29:24.374970) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:26.082893 run osmo-stp_10.42.42.5(pid=22620): stderr: | [0;m[38;5;43m20221209162924543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162924543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162924543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162924544 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162924546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162924546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162924546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:26.226953 run patchelf(pid=22623): Terminating (SIGINT) 16:29:26.393088 run patchelf(pid=22623): Terminated: ok {rc=0} 16:29:26.512332 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22620): Process ended prematurely: osmo-stp_10.42.42.5(pid=22620) [trial-2361↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22620)] [trial-2361↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:29:26.521208 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 16:29:26.547778 run osmo-hlr_10.42.42.2(pid=22617): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22617)] 16:29:26.595488 run osmo-hlr_10.42.42.2(pid=22617): stdout: | (launched: 2022-12-09_16:29:23.447002) 16:29:26.644492 run osmo-hlr_10.42.42.2(pid=22617): stderr: | [0;m[1;31m20221209162923622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162923622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162923622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162923622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162923622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162923622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162923635 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162923644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162923644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162923644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:26.693979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22616): Terminating (SIGTERM) 16:29:26.733647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22619): Terminating (SIGTERM) 16:29:26.773511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22622): Terminating (SIGTERM) 16:29:26.813425 --- ParallelTerminationStrategy: PID 22616 died... 16:29:26.832582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22616): Terminated: ok {rc=0} 16:29:26.876547 --- ParallelTerminationStrategy: PID 22619 died... 16:29:26.895301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22619): Terminated: ok {rc=0} 16:29:26.939006 --- ParallelTerminationStrategy: PID 22622 died... 16:29:26.957712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22622): Terminated: ok {rc=0} 16:29:27.040470 bus /gobi_0: Setting Powered False 16:29:28.138028 bus /gobi_0: Setting Powered False 16:29:29.253903 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:29:30.503205 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:29:30.508807 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:29:30.541600 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:29:30.575843 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:29:30.629943 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:29:30.663332 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:29:30.697779 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:29:31.275441 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:29:31.282543 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:31.297312 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:29:31.381372 tst switch_tch_pdch.py: using LAC 22292 16:29:31.527881 tst switch_tch_pdch.py: using RAC 107 16:29:31.657088 tst switch_tch_pdch.py: using CellId 22292 16:29:31.773182 tst switch_tch_pdch.py: using BVCI 22293 16:29:31.892341 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:31.904861 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:31.918445 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:31.930852 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:31.944669 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:31.959492 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:31.973521 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:29:31.986839 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:29:32.114554 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:29:32.242697 tst switch_tch_pdch.py:51: start network... 16:29:32.461166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:32.927412 run create_hlr_db(pid=22630): Launched 16:29:33.049406 bus /gobi_6: Setting Powered False 16:29:34.112463 run create_hlr_db(pid=22630): Terminated: ok {rc=0} 16:29:34.529179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22632): Launched 16:29:34.848278 run osmo-hlr_10.42.42.2(pid=22633): Launched 16:29:34.970093 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:35.492766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22635): Launched 16:29:35.811289 run osmo-stp_10.42.42.5(pid=22636): Launched 16:29:35.933115 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:36.454288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22638): Launched 16:29:36.578036 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:36.846735 run patchelf(pid=22639): Launched 16:29:37.025744 run osmo-stp_10.42.42.5(pid=22636): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22636)] 16:29:37.160072 run osmo-stp_10.42.42.5(pid=22636): stdout: | (launched: 2022-12-09_16:29:35.753323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:37.296133 run osmo-stp_10.42.42.5(pid=22636): stderr: | [0;m[38;5;43m20221209162935947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162935947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162935947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162935947 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162935948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162935948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162935948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:37.432387 run osmo-stp_10.42.42.5(pid=22636): stdout: | (launched: 2022-12-09_16:29:35.753323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:37.562728 run osmo-stp_10.42.42.5(pid=22636): stderr: | [0;m[38;5;43m20221209162935947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162935947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162935947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162935947 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162935948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162935948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162935948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:37.716717 run patchelf(pid=22639): Terminating (SIGINT) 16:29:37.895498 run patchelf(pid=22639): Terminated: ok {rc=0} 16:29:38.024076 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22636): Process ended prematurely: osmo-stp_10.42.42.5(pid=22636) [trial-2361↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22636)] [trial-2361↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:29:38.033647 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 16:29:38.062123 run osmo-hlr_10.42.42.2(pid=22633): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22633)] 16:29:38.111882 run osmo-hlr_10.42.42.2(pid=22633): stdout: | (launched: 2022-12-09_16:29:34.790373) 16:29:38.163573 run osmo-hlr_10.42.42.2(pid=22633): stderr: | [0;m[1;31m20221209162934990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162934990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162934990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162934990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162934990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162934990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162935003 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162935011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162935012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162935012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:38.215845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22632): Terminating (SIGTERM) 16:29:38.257461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22635): Terminating (SIGTERM) 16:29:38.299089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22638): Terminating (SIGTERM) 16:29:38.341306 --- ParallelTerminationStrategy: PID 22632 died... 16:29:38.361315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22632): Terminated: ok {rc=0} 16:29:38.407764 --- ParallelTerminationStrategy: PID 22635 died... 16:29:38.427087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22635): Terminated: ok {rc=0} 16:29:38.473356 --- ParallelTerminationStrategy: PID 22638 died... 16:29:38.492707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22638): Terminated: ok {rc=0} 16:29:38.579874 bus /gobi_0: Setting Powered False 16:29:39.678205 bus /gobi_0: Setting Powered False 16:29:40.791202 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 16:29:42.044358 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:29:42.049032 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:29:42.079854 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 16:29:42.086848 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:29:42.139983 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:29:42.169990 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 16:29:42.177043 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:29:42.716462 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 16:29:42.721732 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 16:29:42.732900 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:29:42.777743 tst mo_mt_sms.py: using LAC 22293 16:29:42.901866 tst mo_mt_sms.py: using RAC 108 16:29:43.024770 tst mo_mt_sms.py: using CellId 22293 16:29:43.149460 tst mo_mt_sms.py: using BVCI 22294 16:29:43.266275 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:29:43.378749 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:29:43.498602 tst mo_mt_sms.py:9: start nitb and bts... 16:29:43.715574 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:29:44.361499 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22643): Launched 16:29:44.680516 run osmo-nitb_10.42.42.2(pid=22644): Launched 16:29:44.857072 run osmo-nitb_10.42.42.2(pid=22644): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22644)] 16:29:44.999423 run osmo-nitb_10.42.42.2(pid=22644): stdout: | (launched: 2022-12-09_16:29:44.622445) 16:29:45.143360 run osmo-nitb_10.42.42.2(pid=22644): stderr: | (launched: 2022-12-09_16:29:44.669565) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:29:45.287152 run osmo-nitb_10.42.42.2(pid=22644): stdout: | (launched: 2022-12-09_16:29:44.622445) 16:29:45.425129 run osmo-nitb_10.42.42.2(pid=22644): stderr: | (launched: 2022-12-09_16:29:44.669565) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22644): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22644) [trial-2361↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22644)] 16:29:45.800931 tst osmo-nitb_10.42.42.2(pid=22644): stdout: | (launched: 2022-12-09_16:29:44.622445) 16:29:45.931875 tst osmo-nitb_10.42.42.2(pid=22644): stderr: | (launched: 2022-12-09_16:29:44.669565) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:29:46.086381 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=22644): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22644) [trial-2361↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22644)] [trial-2361↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 16:29:46.096043 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 16:29:46.103736 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22643): Terminating (SIGTERM) 16:29:46.316929 --- ParallelTerminationStrategy: PID 22643 died... 16:29:46.336827 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22643): Terminated: ok {rc=0} 16:29:46.427990 bus /sierra_3: Setting Powered False 16:29:47.530139 bus /sierra_3: Setting Powered False 16:29:48.650131 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 16:29:49.845949 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:29:49.850396 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:29:49.879332 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:29:49.906228 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:29:49.959067 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:29:49.989344 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:29:50.015990 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:29:50.560793 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 16:29:50.566022 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:50.576793 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:29:50.620164 tst mo_mt_sms.py: using LAC 22294 16:29:50.736285 tst mo_mt_sms.py: using RAC 109 16:29:50.855960 tst mo_mt_sms.py: using CellId 22294 16:29:50.972175 tst mo_mt_sms.py: using BVCI 22295 16:29:51.078781 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:51.089596 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:51.100255 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:51.110801 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:51.121357 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:29:51.131807 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:29:51.249340 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:29:51.369432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:51.862024 run create_hlr_db(pid=22648): Launched 16:29:51.986031 bus /sierra_2: Setting Powered False 16:29:53.048650 run create_hlr_db(pid=22648): Terminated: ok {rc=0} 16:29:53.474085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22650): Launched 16:29:53.771026 run osmo-hlr_10.42.42.2(pid=22651): Launched 16:29:53.883530 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:54.395842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22653): Launched 16:29:54.692835 run osmo-stp_10.42.42.5(pid=22654): Launched 16:29:54.805745 run osmo-msc_10.42.42.6: Starting osmo-msc 16:29:55.345457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22656): Launched 16:29:55.642158 run osmo-msc_10.42.42.6(pid=22657): Launched 16:29:55.807708 run osmo-stp_10.42.42.5(pid=22654): ERR: Terminated: ERROR {rc=1} [trial-2361↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22654)] 16:29:55.933153 run osmo-stp_10.42.42.5(pid=22654): stdout: | (launched: 2022-12-09_16:29:54.638506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:56.059116 run osmo-stp_10.42.42.5(pid=22654): stderr: | [0;m[38;5;43m20221209162954809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162954810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162954810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162954810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162954811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162954811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162954811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:56.182588 run osmo-stp_10.42.42.5(pid=22654): stdout: | (launched: 2022-12-09_16:29:54.638506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:56.301107 run osmo-stp_10.42.42.5(pid=22654): stderr: | [0;m[38;5;43m20221209162954809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209162954810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209162954810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209162954810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209162954811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209162954811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209162954811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:56.443131 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22654): Process ended prematurely: osmo-stp_10.42.42.5(pid=22654) [trial-2361↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22654)] [trial-2361↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 16:29:56.451473 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 16:29:56.478216 run osmo-hlr_10.42.42.2(pid=22651): ERR: Terminated: ERROR {rc=237} [trial-2361↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22651)] 16:29:56.525633 run osmo-hlr_10.42.42.2(pid=22651): stdout: | (launched: 2022-12-09_16:29:53.716786) 16:29:56.574669 run osmo-hlr_10.42.42.2(pid=22651): stderr: | [0;m[1;31m20221209162953892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209162953892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209162953893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209162953893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209162953893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209162953893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209162953904 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209162953913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209162953913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209162953914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:56.643048 run osmo-msc_10.42.42.6(pid=22657): ERR: Terminated: ERROR {rc=2} [trial-2361↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22657)] 16:29:56.690289 run osmo-msc_10.42.42.6(pid=22657): stdout: | (launched: 2022-12-09_16:29:55.587556) 16:29:56.738991 run osmo-msc_10.42.42.6(pid=22657): stderr: | [0;m[38;5;43m20221209162955859 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209162955860 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fae9ca57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209162955860 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209162955860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209162955860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209162955860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209162955862 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209162955862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209162955863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209162955863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:29:56.788194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22650): Terminating (SIGTERM) 16:29:56.827432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22653): Terminating (SIGTERM) 16:29:56.866923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22656): Terminating (SIGTERM) 16:29:56.906727 --- ParallelTerminationStrategy: PID 22650 died... 16:29:56.925735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22650): Terminated: ok {rc=0} 16:29:56.970014 --- ParallelTerminationStrategy: PID 22653 died... 16:29:56.988637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22653): Terminated: ok {rc=0} 16:29:57.032208 --- ParallelTerminationStrategy: PID 22656 died... 16:29:57.050823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22656): Terminated: ok {rc=0} 16:29:57.133653 bus /sierra_3: Setting Powered False 16:29:58.229198 bus /sierra_3: Setting Powered False 16:29:59.343517 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 16:30:00.567812 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:30:00.572640 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:30:00.605020 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 16:30:00.612076 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 16:30:00.648874 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:30:00.679256 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 16:30:00.686440 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 16:30:01.226463 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2361 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 16:30:01.234686 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 16:30:01.250290 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:30:01.304140 tst assert_extension.py: using LAC 22295 16:30:01.469442 tst assert_extension.py: using RAC 110 16:30:01.631128 tst assert_extension.py: using CellId 22295 16:30:01.750548 tst assert_extension.py: using BVCI 22296 16:30:01.913992 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 16:30:02.051079 tst assert_extension.py:10: start nitb and bts... 16:30:02.277134 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:30:02.892188 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22665): Launched 16:30:03.190198 run osmo-nitb_10.42.42.2(pid=22666): Launched 16:30:03.356624 run osmo-nitb_10.42.42.2(pid=22666): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22666)] 16:30:03.490118 run osmo-nitb_10.42.42.2(pid=22666): stdout: | (launched: 2022-12-09_16:30:03.135536) 16:30:03.625387 run osmo-nitb_10.42.42.2(pid=22666): stderr: | (launched: 2022-12-09_16:30:03.179773) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:30:03.760487 run osmo-nitb_10.42.42.2(pid=22666): stdout: | (launched: 2022-12-09_16:30:03.135536) 16:30:03.889693 run osmo-nitb_10.42.42.2(pid=22666): stderr: | (launched: 2022-12-09_16:30:03.179773) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22666): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22666) [trial-2361↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22666)] 16:30:04.304417 tst osmo-nitb_10.42.42.2(pid=22666): stdout: | (launched: 2022-12-09_16:30:03.135536) 16:30:04.424180 tst osmo-nitb_10.42.42.2(pid=22666): stderr: | (launched: 2022-12-09_16:30:03.179773) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:30:04.566277 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22666): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22666) [trial-2361↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22666)] [trial-2361↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 16:30:04.574424 tst assert_extension.py:12: Test FAILED (3.3 sec) 16:30:04.581017 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22665): Terminating (SIGTERM) 16:30:04.789271 --- ParallelTerminationStrategy: PID 22665 died... 16:30:04.809518 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22665): Terminated: ok {rc=0} 16:30:04.894621 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 16:30:06.071594 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:30:06.075942 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:30:06.108140 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:30:06.135913 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 16:30:06.171261 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:30:06.200696 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:30:06.227640 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 16:30:06.760630 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2361 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 16:30:06.766857 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:30:06.778778 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:30:06.824417 tst assert_extension.py: using LAC 22296 16:30:06.946968 tst assert_extension.py: using RAC 111 16:30:07.070170 tst assert_extension.py: using CellId 22296 16:30:07.192900 tst assert_extension.py: using BVCI 22297 16:30:07.307875 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:30:07.319374 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:30:07.330754 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:30:07.342289 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:30:07.353894 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:30:07.365274 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 16:30:07.481306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:07.940231 run create_hlr_db(pid=22670): Launched 16:30:08.062701 bus /sierra_2: Setting Powered False 16:30:09.122376 run create_hlr_db(pid=22670): Terminated: ok {rc=0} 16:30:09.557601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22672): Launched 16:30:09.877658 run osmo-hlr_10.42.42.2(pid=22673): Launched 16:30:10.001271 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:10.554749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22675): Launched 16:30:10.876842 run osmo-stp_10.42.42.5(pid=22676): Launched 16:30:11.000676 run osmo-msc_10.42.42.6: Starting osmo-msc 16:30:11.576852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22678): Launched 16:30:11.896692 run osmo-msc_10.42.42.6(pid=22679): Launched 16:30:12.075192 run osmo-stp_10.42.42.5(pid=22676): ERR: Terminated: ERROR {rc=1} [trial-2361↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22676)] 16:30:12.209828 run osmo-stp_10.42.42.5(pid=22676): stdout: | (launched: 2022-12-09_16:30:10.818471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:12.344532 run osmo-stp_10.42.42.5(pid=22676): stderr: | [0;m[38;5;43m20221209163011012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163011012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163011012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163011013 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163011013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163011013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163011014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:12.478289 run osmo-stp_10.42.42.5(pid=22676): stdout: | (launched: 2022-12-09_16:30:10.818471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:12.605582 run osmo-stp_10.42.42.5(pid=22676): stderr: | [0;m[38;5;43m20221209163011012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163011012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163011012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163011013 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163011013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163011013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163011014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:12.757868 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22676): Process ended prematurely: osmo-stp_10.42.42.5(pid=22676) [trial-2361↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22676)] [trial-2361↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 16:30:12.767042 tst assert_extension.py:17: Test FAILED (6.0 sec) 16:30:12.794649 run osmo-hlr_10.42.42.2(pid=22673): ERR: Terminated: ERROR {rc=237} [trial-2361↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22673)] 16:30:12.844738 run osmo-hlr_10.42.42.2(pid=22673): stdout: | (launched: 2022-12-09_16:30:09.819865) 16:30:12.895947 run osmo-hlr_10.42.42.2(pid=22673): stderr: | [0;m[1;31m20221209163010017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163010017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163010017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163010017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163010017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163010017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163010029 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163010037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163010037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163010037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:12.967710 run osmo-msc_10.42.42.6(pid=22679): ERR: Terminated: ERROR {rc=2} [trial-2361↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22679)] 16:30:13.017466 run osmo-msc_10.42.42.6(pid=22679): stdout: | (launched: 2022-12-09_16:30:11.838076) 16:30:13.068636 run osmo-msc_10.42.42.6(pid=22679): stderr: | [0;m[38;5;43m20221209163012161 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163012161 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f269efe4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163012161 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163012161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163012162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163012162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163012163 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163012164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163012164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163012164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:30:13.120390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22672): Terminating (SIGTERM) 16:30:13.161776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22675): Terminating (SIGTERM) 16:30:13.203295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22678): Terminating (SIGTERM) 16:30:13.245285 --- ParallelTerminationStrategy: PID 22672 died... 16:30:13.264885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22672): Terminated: ok {rc=0} 16:30:13.311298 --- ParallelTerminationStrategy: PID 22675 died... 16:30:13.330732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22675): Terminated: ok {rc=0} 16:30:13.376836 --- ParallelTerminationStrategy: PID 22678 died... 16:30:13.396636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22678): Terminated: ok {rc=0} 16:30:13.483544 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:30:14.694194 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:30:14.701285 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:30:14.731833 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:30:14.759436 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:30:14.814664 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:30:14.844799 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:30:14.872622 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:30:15.427828 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:30:15.482367 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:15.494176 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:30:15.560298 tst mo_mt_call.py: using LAC 22297 16:30:15.684434 tst mo_mt_call.py: using RAC 112 16:30:15.810115 tst mo_mt_call.py: using CellId 22297 16:30:15.963107 tst mo_mt_call.py: using BVCI 22298 16:30:16.077620 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:16.089579 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:16.101681 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:16.114291 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:16.126628 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:16.138328 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:30:16.260203 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:30:16.407168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:16.931988 run create_hlr_db(pid=22684): Launched 16:30:17.090486 bus /sierra_2: Setting Powered False 16:30:18.154377 run create_hlr_db(pid=22684): Terminated: ok {rc=0} 16:30:18.605774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22686): Launched 16:30:18.932034 run osmo-hlr_10.42.42.2(pid=22687): Launched 16:30:19.056107 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:19.612572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22689): Launched 16:30:19.937005 run osmo-stp_10.42.42.5(pid=22690): Launched 16:30:20.062727 run osmo-msc_10.42.42.6: Starting osmo-msc 16:30:20.647657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22692): Launched 16:30:20.972405 run osmo-msc_10.42.42.6(pid=22693): Launched 16:30:21.153902 run osmo-stp_10.42.42.5(pid=22690): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22690)] 16:30:21.290705 run osmo-stp_10.42.42.5(pid=22690): stdout: | (launched: 2022-12-09_16:30:19.878156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:21.428307 run osmo-stp_10.42.42.5(pid=22690): stderr: | [0;m[38;5;43m20221209163020070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163020070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163020071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163020071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163020071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163020072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163020072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:21.564558 run osmo-stp_10.42.42.5(pid=22690): stdout: | (launched: 2022-12-09_16:30:19.878156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:21.693346 run osmo-stp_10.42.42.5(pid=22690): stderr: | [0;m[38;5;43m20221209163020070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163020070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163020071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163020071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163020071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163020072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163020072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:21.847538 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22690): Process ended prematurely: osmo-stp_10.42.42.5(pid=22690) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22690)] [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:30:21.856916 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:30:21.885395 run osmo-hlr_10.42.42.2(pid=22687): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22687)] 16:30:21.934980 run osmo-hlr_10.42.42.2(pid=22687): stdout: | (launched: 2022-12-09_16:30:18.873170) 16:30:21.986552 run osmo-hlr_10.42.42.2(pid=22687): stderr: | [0;m[1;31m20221209163019072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163019073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163019073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163019073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163019073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163019073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163019085 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163019093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163019093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163019093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:22.058252 run osmo-msc_10.42.42.6(pid=22693): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22693)] 16:30:22.107671 run osmo-msc_10.42.42.6(pid=22693): stdout: | (launched: 2022-12-09_16:30:20.912885) 16:30:22.158917 run osmo-msc_10.42.42.6(pid=22693): stderr: | [0;m[38;5;43m20221209163021234 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163021234 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efef37d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163021234 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163021235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163021235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163021235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163021237 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163021237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163021237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163021237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:30:22.210352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22686): Terminating (SIGTERM) 16:30:22.251663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22689): Terminating (SIGTERM) 16:30:22.293137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22692): Terminating (SIGTERM) 16:30:22.334906 --- ParallelTerminationStrategy: PID 22686 died... 16:30:22.354709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22686): Terminated: ok {rc=0} 16:30:22.401035 --- ParallelTerminationStrategy: PID 22689 died... 16:30:22.420441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22689): Terminated: ok {rc=0} 16:30:22.466537 --- ParallelTerminationStrategy: PID 22692 died... 16:30:22.485911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22692): Terminated: ok {rc=0} 16:30:22.572436 bus /sierra_3: Setting Powered False 16:30:23.670480 bus /sierra_3: Setting Powered False 16:30:24.785069 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:30:25.930384 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:25.942704 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:30:26.012119 tst mo_mt_call_osmux.py: using LAC 22298 16:30:26.129765 tst mo_mt_call_osmux.py: using RAC 113 16:30:26.249127 tst mo_mt_call_osmux.py: using CellId 22298 16:30:26.367069 tst mo_mt_call_osmux.py: using BVCI 22299 16:30:26.475484 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:26.486851 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:26.497938 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:26.509020 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:26.520165 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:30:26.531239 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:30:26.647125 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:30:26.766944 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:27.269542 run create_hlr_db(pid=22695): Launched 16:30:27.395947 bus /sierra_2: Setting Powered False 16:30:28.460130 run create_hlr_db(pid=22695): Terminated: ok {rc=0} 16:30:28.895345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22697): Launched 16:30:29.199705 run osmo-hlr_10.42.42.2(pid=22698): Launched 16:30:29.315249 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:29.850926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22700): Launched 16:30:30.153381 run osmo-stp_10.42.42.5(pid=22701): Launched 16:30:30.267676 run osmo-msc_10.42.42.6: Starting osmo-msc 16:30:30.818777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22703): Launched 16:30:31.175792 run osmo-msc_10.42.42.6(pid=22704): Launched 16:30:31.542277 run osmo-stp_10.42.42.5(pid=22701): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22701)] 16:30:31.827344 run osmo-stp_10.42.42.5(pid=22701): stdout: | (launched: 2022-12-09_16:30:30.097832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:32.000066 run osmo-stp_10.42.42.5(pid=22701): stderr: | [0;m[38;5;43m20221209163030269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163030269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163030269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163030270 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163030272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163030272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163030272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:32.140420 run osmo-stp_10.42.42.5(pid=22701): stdout: | (launched: 2022-12-09_16:30:30.097832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:32.274157 run osmo-stp_10.42.42.5(pid=22701): stderr: | [0;m[38;5;43m20221209163030269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163030269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163030269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163030270 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163030272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163030272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163030272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:32.429658 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22701): Process ended prematurely: osmo-stp_10.42.42.5(pid=22701) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22701)] [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:30:32.439109 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 16:30:32.467702 run osmo-hlr_10.42.42.2(pid=22698): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22698)] 16:30:32.517899 run osmo-hlr_10.42.42.2(pid=22698): stdout: | (launched: 2022-12-09_16:30:29.143475) 16:30:32.569574 run osmo-hlr_10.42.42.2(pid=22698): stderr: | [0;m[1;31m20221209163029322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163029322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163029322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163029322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163029322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163029322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163029334 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163029343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163029343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163029343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:32.641781 run osmo-msc_10.42.42.6(pid=22704): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22704)] 16:30:32.691482 run osmo-msc_10.42.42.6(pid=22704): stdout: | (launched: 2022-12-09_16:30:31.113502) 16:30:32.742999 run osmo-msc_10.42.42.6(pid=22704): stderr: | [0;m[38;5;43m20221209163031616 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163031616 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6ce998ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163031616 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163031616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163031617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163031617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163031618 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163031619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163031619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163031619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:30:32.795560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22697): Terminating (SIGTERM) 16:30:32.837318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22700): Terminating (SIGTERM) 16:30:32.879193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22703): Terminating (SIGTERM) 16:30:32.921308 --- ParallelTerminationStrategy: PID 22697 died... 16:30:32.941224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22697): Terminated: ok {rc=0} 16:30:32.987675 --- ParallelTerminationStrategy: PID 22700 died... 16:30:33.007162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22700): Terminated: ok {rc=0} 16:30:33.053323 --- ParallelTerminationStrategy: PID 22703 died... 16:30:33.072567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22703): Terminated: ok {rc=0} 16:30:33.160447 bus /sierra_3: Setting Powered False 16:30:34.257891 bus /sierra_3: Setting Powered False 16:30:35.373941 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:30:36.620626 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:30:36.627511 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:30:36.659904 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:30:36.687500 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:30:36.742171 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:30:36.773279 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:30:36.801439 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:30:37.356164 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:30:37.410258 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:37.422073 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:30:37.502380 tst mo_mt_call.py: using LAC 22299 16:30:37.624666 tst mo_mt_call.py: using RAC 114 16:30:37.743794 tst mo_mt_call.py: using CellId 22299 16:30:37.861500 tst mo_mt_call.py: using BVCI 22300 16:30:37.971117 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:37.982626 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:37.993956 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:38.005975 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:38.018001 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:38.029814 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:30:38.146866 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:30:38.268662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:38.771168 run create_hlr_db(pid=22709): Launched 16:30:38.896670 bus /sierra_2: Setting Powered False 16:30:39.961151 run create_hlr_db(pid=22709): Terminated: ok {rc=0} 16:30:40.393687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22711): Launched 16:30:40.697060 run osmo-hlr_10.42.42.2(pid=22712): Launched 16:30:40.812909 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:41.336869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22714): Launched 16:30:41.640213 run osmo-stp_10.42.42.5(pid=22715): Launched 16:30:41.755394 run osmo-msc_10.42.42.6: Starting osmo-msc 16:30:42.302967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22717): Launched 16:30:42.607039 run osmo-msc_10.42.42.6(pid=22718): Launched 16:30:42.776190 run osmo-stp_10.42.42.5(pid=22715): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22715)] 16:30:42.904646 run osmo-stp_10.42.42.5(pid=22715): stdout: | (launched: 2022-12-09_16:30:41.584689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:43.032735 run osmo-stp_10.42.42.5(pid=22715): stderr: | [0;m[38;5;43m20221209163041755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163041755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163041756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163041756 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163041756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163041757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163041757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:43.158635 run osmo-stp_10.42.42.5(pid=22715): stdout: | (launched: 2022-12-09_16:30:41.584689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:43.278630 run osmo-stp_10.42.42.5(pid=22715): stderr: | [0;m[38;5;43m20221209163041755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163041755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163041756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163041756 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163041756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163041757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163041757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:43.422509 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22715): Process ended prematurely: osmo-stp_10.42.42.5(pid=22715) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22715)] [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:30:43.431332 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:30:43.457674 run osmo-hlr_10.42.42.2(pid=22712): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22712)] 16:30:43.504577 run osmo-hlr_10.42.42.2(pid=22712): stdout: | (launched: 2022-12-09_16:30:40.641680) 16:30:43.553408 run osmo-hlr_10.42.42.2(pid=22712): stderr: | [0;m[1;31m20221209163040821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163040821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163040821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163040821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163040822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163040822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163040834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163040845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163040845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163040845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:43.621417 run osmo-msc_10.42.42.6(pid=22718): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22718)] 16:30:43.668159 run osmo-msc_10.42.42.6(pid=22718): stdout: | (launched: 2022-12-09_16:30:42.551398) 16:30:43.716698 run osmo-msc_10.42.42.6(pid=22718): stderr: | [0;m[38;5;43m20221209163042822 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163042823 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3868691c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163042823 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163042823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163042823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163042823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163042827 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163042828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163042828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163042828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:30:43.765687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22711): Terminating (SIGTERM) 16:30:43.804699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22714): Terminating (SIGTERM) 16:30:43.843761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22717): Terminating (SIGTERM) 16:30:43.883098 --- ParallelTerminationStrategy: PID 22711 died... 16:30:43.901962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22711): Terminated: ok {rc=0} 16:30:43.945693 --- ParallelTerminationStrategy: PID 22714 died... 16:30:43.964201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22714): Terminated: ok {rc=0} 16:30:44.007758 --- ParallelTerminationStrategy: PID 22717 died... 16:30:44.026240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22717): Terminated: ok {rc=0} 16:30:44.110953 bus /sierra_3: Setting Powered False 16:30:45.210218 bus /sierra_3: Setting Powered False 16:30:46.323071 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:30:47.470856 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:47.483546 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:30:47.550809 tst mo_mt_call_osmux.py: using LAC 22300 16:30:47.678061 tst mo_mt_call_osmux.py: using RAC 115 16:30:47.804677 tst mo_mt_call_osmux.py: using CellId 22300 16:30:47.933145 tst mo_mt_call_osmux.py: using BVCI 22301 16:30:48.052490 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:48.064595 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:48.076327 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:48.088179 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:48.100317 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:30:48.112380 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:30:48.229500 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:30:48.351108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:48.854099 run create_hlr_db(pid=22720): Launched 16:30:48.979976 bus /sierra_2: Setting Powered False 16:30:50.044625 run create_hlr_db(pid=22720): Terminated: ok {rc=0} 16:30:50.477643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22722): Launched 16:30:50.779456 run osmo-hlr_10.42.42.2(pid=22723): Launched 16:30:50.894165 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:51.413393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22725): Launched 16:30:51.716896 run osmo-stp_10.42.42.5(pid=22726): Launched 16:30:51.832439 run osmo-msc_10.42.42.6: Starting osmo-msc 16:30:52.381168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22728): Launched 16:30:52.685589 run osmo-msc_10.42.42.6(pid=22729): Launched 16:30:52.857510 run osmo-stp_10.42.42.5(pid=22726): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22726)] 16:30:52.986129 run osmo-stp_10.42.42.5(pid=22726): stdout: | (launched: 2022-12-09_16:30:51.660938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:53.114523 run osmo-stp_10.42.42.5(pid=22726): stderr: | [0;m[38;5;43m20221209163051833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163051833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163051833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163051833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163051834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163051834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163051834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:53.240553 run osmo-stp_10.42.42.5(pid=22726): stdout: | (launched: 2022-12-09_16:30:51.660938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:53.360634 run osmo-stp_10.42.42.5(pid=22726): stderr: | [0;m[38;5;43m20221209163051833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163051833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163051833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163051833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163051834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163051834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163051834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:53.504617 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22726): Process ended prematurely: osmo-stp_10.42.42.5(pid=22726) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22726)] [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:30:53.513463 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 16:30:53.540201 run osmo-hlr_10.42.42.2(pid=22723): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22723)] 16:30:53.587744 run osmo-hlr_10.42.42.2(pid=22723): stdout: | (launched: 2022-12-09_16:30:50.723921) 16:30:53.636894 run osmo-hlr_10.42.42.2(pid=22723): stderr: | [0;m[1;31m20221209163050900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163050900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163050900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163050900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163050900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163050900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163050912 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163050922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163050922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163050922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:53.705935 run osmo-msc_10.42.42.6(pid=22729): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22729)] 16:30:53.754043 run osmo-msc_10.42.42.6(pid=22729): stdout: | (launched: 2022-12-09_16:30:52.629692) 16:30:53.803125 run osmo-msc_10.42.42.6(pid=22729): stderr: | [0;m[38;5;43m20221209163052903 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163052903 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7e62494c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163052903 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163052903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163052903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163052904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163052906 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163052906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163052906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163052906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:30:53.852523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22722): Terminating (SIGTERM) 16:30:53.892136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22725): Terminating (SIGTERM) 16:30:53.931785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22728): Terminating (SIGTERM) 16:30:53.971598 --- ParallelTerminationStrategy: PID 22722 died... 16:30:53.990689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22722): Terminated: ok {rc=0} 16:30:54.034793 --- ParallelTerminationStrategy: PID 22725 died... 16:30:54.053510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22725): Terminated: ok {rc=0} 16:30:54.097318 --- ParallelTerminationStrategy: PID 22728 died... 16:30:54.116132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22728): Terminated: ok {rc=0} 16:30:54.202819 bus /sierra_3: Setting Powered False 16:30:55.301640 bus /sierra_3: Setting Powered False 16:30:56.415016 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:30:57.666253 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:30:57.673275 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:30:57.703685 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:30:57.731129 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:30:57.786482 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:30:57.816365 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:30:57.843309 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:30:58.396391 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:30:58.449758 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:58.461634 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:30:58.529902 tst mo_mt_call.py: using LAC 22301 16:30:58.657665 tst mo_mt_call.py: using RAC 116 16:30:58.776749 tst mo_mt_call.py: using CellId 22301 16:30:58.896521 tst mo_mt_call.py: using BVCI 22302 16:30:59.007243 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:59.018645 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:59.029743 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:59.040732 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:59.051962 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:30:59.063073 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:30:59.182075 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:30:59.302661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:59.807138 run create_hlr_db(pid=22735): Launched 16:30:59.932736 bus /sierra_2: Setting Powered False 16:31:01.005403 run create_hlr_db(pid=22735): Terminated: ok {rc=0} 16:31:01.441514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22737): Launched 16:31:01.771658 run osmo-hlr_10.42.42.2(pid=22738): Launched 16:31:01.908132 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:02.571461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22740): Launched 16:31:02.875631 run osmo-stp_10.42.42.5(pid=22741): Launched 16:31:02.992682 run osmo-msc_10.42.42.6: Starting osmo-msc 16:31:03.559729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22743): Launched 16:31:03.865454 run osmo-msc_10.42.42.6(pid=22744): Launched 16:31:04.035300 run osmo-stp_10.42.42.5(pid=22741): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22741)] 16:31:04.163871 run osmo-stp_10.42.42.5(pid=22741): stdout: | (launched: 2022-12-09_16:31:02.819954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:04.292135 run osmo-stp_10.42.42.5(pid=22741): stderr: | [0;m[38;5;43m20221209163102993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163102994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163102994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163102994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163102995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163102995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163102995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:04.418750 run osmo-stp_10.42.42.5(pid=22741): stdout: | (launched: 2022-12-09_16:31:02.819954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:04.539057 run osmo-stp_10.42.42.5(pid=22741): stderr: | [0;m[38;5;43m20221209163102993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163102994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163102994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163102994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163102995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163102995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163102995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:04.683145 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22741): Process ended prematurely: osmo-stp_10.42.42.5(pid=22741) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22741)] [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:31:04.691947 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:31:04.717965 run osmo-hlr_10.42.42.2(pid=22738): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22738)] 16:31:04.764494 run osmo-hlr_10.42.42.2(pid=22738): stdout: | (launched: 2022-12-09_16:31:01.710415) 16:31:04.812832 run osmo-hlr_10.42.42.2(pid=22738): stderr: | [0;m[1;31m20221209163102091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163102091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163102092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163102092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163102092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163102092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163102114 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163102131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163102131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163102131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:04.880592 run osmo-msc_10.42.42.6(pid=22744): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22744)] 16:31:04.927141 run osmo-msc_10.42.42.6(pid=22744): stdout: | (launched: 2022-12-09_16:31:03.808668) 16:31:04.975365 run osmo-msc_10.42.42.6(pid=22744): stderr: | [0;m[38;5;43m20221209163104082 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163104082 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f50048d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163104083 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163104083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163104083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163104083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163104086 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163104086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163104086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163104086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:31:05.024207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22737): Terminating (SIGTERM) 16:31:05.063284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22740): Terminating (SIGTERM) 16:31:05.102364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22743): Terminating (SIGTERM) 16:31:05.141809 --- ParallelTerminationStrategy: PID 22737 died... 16:31:05.160541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22737): Terminated: ok {rc=0} 16:31:05.204033 --- ParallelTerminationStrategy: PID 22740 died... 16:31:05.222483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22740): Terminated: ok {rc=0} 16:31:05.265596 --- ParallelTerminationStrategy: PID 22743 died... 16:31:05.284059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22743): Terminated: ok {rc=0} 16:31:05.365737 bus /sierra_3: Setting Powered False 16:31:06.462296 bus /sierra_3: Setting Powered False 16:31:07.578095 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:31:08.723413 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:31:08.735539 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:31:08.800548 tst mo_mt_call_osmux.py: using LAC 22302 16:31:08.926875 tst mo_mt_call_osmux.py: using RAC 117 16:31:09.052639 tst mo_mt_call_osmux.py: using CellId 22302 16:31:09.177764 tst mo_mt_call_osmux.py: using BVCI 22303 16:31:09.288294 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:31:09.299682 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:31:09.310913 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:31:09.322111 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:31:09.333353 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:31:09.344403 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:31:09.467495 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:31:09.589393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:10.060456 run create_hlr_db(pid=22746): Launched 16:31:10.185117 bus /sierra_2: Setting Powered False 16:31:11.245588 run create_hlr_db(pid=22746): Terminated: ok {rc=0} 16:31:11.689117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22748): Launched 16:31:12.016852 run osmo-hlr_10.42.42.2(pid=22749): Launched 16:31:12.142727 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:12.706114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22751): Launched 16:31:13.032389 run osmo-stp_10.42.42.5(pid=22752): Launched 16:31:13.157278 run osmo-msc_10.42.42.6: Starting osmo-msc 16:31:13.747366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22754): Launched 16:31:14.074243 run osmo-msc_10.42.42.6(pid=22755): Launched 16:31:14.256127 run osmo-stp_10.42.42.5(pid=22752): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22752)] 16:31:14.393179 run osmo-stp_10.42.42.5(pid=22752): stdout: | (launched: 2022-12-09_16:31:12.973324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:14.530551 run osmo-stp_10.42.42.5(pid=22752): stderr: | [0;m[38;5;43m20221209163113167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163113167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163113167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163113167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163113168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163113168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163113168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:14.667299 run osmo-stp_10.42.42.5(pid=22752): stdout: | (launched: 2022-12-09_16:31:12.973324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:14.796789 run osmo-stp_10.42.42.5(pid=22752): stderr: | [0;m[38;5;43m20221209163113167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163113167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163113167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163113167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163113168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163113168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163113168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:14.951377 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22752): Process ended prematurely: osmo-stp_10.42.42.5(pid=22752) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22752)] [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:31:14.960768 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:31:14.989233 run osmo-hlr_10.42.42.2(pid=22749): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22749)] 16:31:15.039159 run osmo-hlr_10.42.42.2(pid=22749): stdout: | (launched: 2022-12-09_16:31:11.957665) 16:31:15.090948 run osmo-hlr_10.42.42.2(pid=22749): stderr: | [0;m[1;31m20221209163112157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163112157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163112157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163112158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163112158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163112158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163112170 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163112178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163112179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163112179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:15.163530 run osmo-msc_10.42.42.6(pid=22755): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22755)] 16:31:15.213460 run osmo-msc_10.42.42.6(pid=22755): stdout: | (launched: 2022-12-09_16:31:14.015102) 16:31:15.265287 run osmo-msc_10.42.42.6(pid=22755): stderr: | [0;m[38;5;43m20221209163114339 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163114339 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f00fccc4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163114339 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163114339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163114339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163114339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163114341 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163114342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163114342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163114342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:31:15.317413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22748): Terminating (SIGTERM) 16:31:15.359061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22751): Terminating (SIGTERM) 16:31:15.400649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22754): Terminating (SIGTERM) 16:31:15.442587 --- ParallelTerminationStrategy: PID 22748 died... 16:31:15.462542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22748): Terminated: ok {rc=0} 16:31:15.508830 --- ParallelTerminationStrategy: PID 22751 died... 16:31:15.528788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22751): Terminated: ok {rc=0} 16:31:15.575012 --- ParallelTerminationStrategy: PID 22754 died... 16:31:15.594568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22754): Terminated: ok {rc=0} 16:31:15.681646 bus /sierra_3: Setting Powered False 16:31:16.781671 bus /sierra_3: Setting Powered False 16:31:17.896107 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:31:19.149579 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:31:19.156404 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:31:19.185364 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:31:19.211854 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:31:19.261919 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:31:19.290729 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:31:19.317254 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:31:19.873129 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:31:19.921504 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:19.932644 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:31:19.996393 tst mo_mt_call.py: using LAC 22303 16:31:20.113268 tst mo_mt_call.py: using RAC 118 16:31:20.232319 tst mo_mt_call.py: using CellId 22303 16:31:20.349608 tst mo_mt_call.py: using BVCI 22304 16:31:20.458580 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:20.469944 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:20.481205 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:20.492320 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:20.503535 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:20.514635 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:31:20.631782 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:31:20.752396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:21.257597 run create_hlr_db(pid=22760): Launched 16:31:21.384237 bus /sierra_2: Setting Powered False 16:31:22.447534 run create_hlr_db(pid=22760): Terminated: ok {rc=0} 16:31:22.882579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22762): Launched 16:31:23.187802 run osmo-hlr_10.42.42.2(pid=22763): Launched 16:31:23.303571 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:23.825710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22765): Launched 16:31:24.127894 run osmo-stp_10.42.42.5(pid=22766): Launched 16:31:24.243060 run osmo-msc_10.42.42.6: Starting osmo-msc 16:31:24.790769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22768): Launched 16:31:25.096738 run osmo-msc_10.42.42.6(pid=22769): Launched 16:31:25.267312 run osmo-stp_10.42.42.5(pid=22766): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22766)] 16:31:25.395329 run osmo-stp_10.42.42.5(pid=22766): stdout: | (launched: 2022-12-09_16:31:24.072329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:25.522848 run osmo-stp_10.42.42.5(pid=22766): stderr: | [0;m[38;5;43m20221209163124245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163124245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163124246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163124246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163124246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163124246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163124247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:25.648320 run osmo-stp_10.42.42.5(pid=22766): stdout: | (launched: 2022-12-09_16:31:24.072329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:25.767816 run osmo-stp_10.42.42.5(pid=22766): stderr: | [0;m[38;5;43m20221209163124245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163124245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163124246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163124246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163124246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163124246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163124247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:25.911660 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22766): Process ended prematurely: osmo-stp_10.42.42.5(pid=22766) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22766)] [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:31:25.920520 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 16:31:25.946685 run osmo-hlr_10.42.42.2(pid=22763): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22763)] 16:31:25.993366 run osmo-hlr_10.42.42.2(pid=22763): stdout: | (launched: 2022-12-09_16:31:23.131282) 16:31:26.041697 run osmo-hlr_10.42.42.2(pid=22763): stderr: | [0;m[1;31m20221209163123309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163123309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163123309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163123309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163123309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163123309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163123321 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163123330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163123330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163123330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:26.109694 run osmo-msc_10.42.42.6(pid=22769): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22769)] 16:31:26.156452 run osmo-msc_10.42.42.6(pid=22769): stdout: | (launched: 2022-12-09_16:31:25.040853) 16:31:26.204838 run osmo-msc_10.42.42.6(pid=22769): stderr: | [0;m[38;5;43m20221209163125313 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163125313 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1e40b88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163125313 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163125313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163125313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163125313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163125315 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163125316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163125316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163125316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:31:26.253788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22762): Terminating (SIGTERM) 16:31:26.292762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22765): Terminating (SIGTERM) 16:31:26.331774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22768): Terminating (SIGTERM) 16:31:26.371226 --- ParallelTerminationStrategy: PID 22762 died... 16:31:26.390228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22762): Terminated: ok {rc=0} 16:31:26.433728 --- ParallelTerminationStrategy: PID 22765 died... 16:31:26.451998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22765): Terminated: ok {rc=0} 16:31:26.495525 --- ParallelTerminationStrategy: PID 22768 died... 16:31:26.514410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22768): Terminated: ok {rc=0} 16:31:26.599268 bus /sierra_3: Setting Powered False 16:31:27.696994 bus /sierra_3: Setting Powered False 16:31:28.808048 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:31:29.948894 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:29.961444 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:31:30.027995 tst mo_mt_call_osmux.py: using LAC 22304 16:31:30.156395 tst mo_mt_call_osmux.py: using RAC 119 16:31:30.283522 tst mo_mt_call_osmux.py: using CellId 22304 16:31:30.410579 tst mo_mt_call_osmux.py: using BVCI 22305 16:31:30.527984 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:30.539845 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:30.551385 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:30.563280 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:30.575265 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:31:30.587075 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:31:30.705259 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:31:30.827305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:31.333684 run create_hlr_db(pid=22771): Launched 16:31:31.498257 bus /sierra_2: Setting Powered False 16:31:32.559218 run create_hlr_db(pid=22771): Terminated: ok {rc=0} 16:31:33.003193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22773): Launched 16:31:33.330154 run osmo-hlr_10.42.42.2(pid=22774): Launched 16:31:33.455524 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:34.017906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22776): Launched 16:31:34.345993 run osmo-stp_10.42.42.5(pid=22777): Launched 16:31:34.471606 run osmo-msc_10.42.42.6: Starting osmo-msc 16:31:35.060439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22779): Launched 16:31:35.388391 run osmo-msc_10.42.42.6(pid=22780): Launched 16:31:35.569160 run osmo-stp_10.42.42.5(pid=22777): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22777)] 16:31:35.706993 run osmo-stp_10.42.42.5(pid=22777): stdout: | (launched: 2022-12-09_16:31:34.286562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:35.846025 run osmo-stp_10.42.42.5(pid=22777): stderr: | [0;m[38;5;43m20221209163134479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163134479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163134479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163134480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163134480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163134480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163134480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:35.982560 run osmo-stp_10.42.42.5(pid=22777): stdout: | (launched: 2022-12-09_16:31:34.286562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:36.112099 run osmo-stp_10.42.42.5(pid=22777): stderr: | [0;m[38;5;43m20221209163134479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163134479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163134479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163134480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163134480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163134480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163134480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:36.267381 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22777): Process ended prematurely: osmo-stp_10.42.42.5(pid=22777) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22777)] [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:31:36.276744 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:31:36.305399 run osmo-hlr_10.42.42.2(pid=22774): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22774)] 16:31:36.355731 run osmo-hlr_10.42.42.2(pid=22774): stdout: | (launched: 2022-12-09_16:31:33.271112) 16:31:36.408152 run osmo-hlr_10.42.42.2(pid=22774): stderr: | [0;m[1;31m20221209163133471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163133471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163133471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163133471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163133471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163133471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163133483 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163133492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163133492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163133492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:36.481096 run osmo-msc_10.42.42.6(pid=22780): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22780)] 16:31:36.531371 run osmo-msc_10.42.42.6(pid=22780): stdout: | (launched: 2022-12-09_16:31:35.328695) 16:31:36.583381 run osmo-msc_10.42.42.6(pid=22780): stderr: | [0;m[38;5;43m20221209163135650 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163135650 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9af7237c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163135650 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163135650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163135650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163135651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163135652 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163135653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163135653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163135653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:31:36.636036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22773): Terminating (SIGTERM) 16:31:36.678048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22776): Terminating (SIGTERM) 16:31:36.720096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22779): Terminating (SIGTERM) 16:31:36.762607 --- ParallelTerminationStrategy: PID 22773 died... 16:31:36.782719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22773): Terminated: ok {rc=0} 16:31:36.829797 --- ParallelTerminationStrategy: PID 22776 died... 16:31:36.849531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22776): Terminated: ok {rc=0} 16:31:36.896203 --- ParallelTerminationStrategy: PID 22779 died... 16:31:36.915924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22779): Terminated: ok {rc=0} 16:31:37.004345 bus /sierra_3: Setting Powered False 16:31:38.105034 bus /sierra_3: Setting Powered False 16:31:39.220008 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:31:40.467562 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:31:40.474577 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:31:40.505503 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:31:40.533062 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:31:40.586040 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:31:40.616293 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:31:40.643323 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:31:41.201780 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:31:41.254198 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:41.265928 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:31:41.334671 tst mo_mt_call.py: using LAC 22305 16:31:41.462370 tst mo_mt_call.py: using RAC 120 16:31:41.588645 tst mo_mt_call.py: using CellId 22305 16:31:41.715157 tst mo_mt_call.py: using BVCI 22306 16:31:41.832780 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:41.844542 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:41.856219 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:41.868010 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:41.879814 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:41.891646 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:31:42.009686 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:31:42.127454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:42.595422 run create_hlr_db(pid=22785): Launched 16:31:42.719817 bus /sierra_2: Setting Powered False 16:31:43.778937 run create_hlr_db(pid=22785): Terminated: ok {rc=0} 16:31:44.224022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22787): Launched 16:31:44.550222 run osmo-hlr_10.42.42.2(pid=22788): Launched 16:31:44.675671 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:45.240012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22790): Launched 16:31:45.568870 run osmo-stp_10.42.42.5(pid=22791): Launched 16:31:45.693423 run osmo-msc_10.42.42.6: Starting osmo-msc 16:31:46.344732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22793): Launched 16:31:46.685279 run osmo-msc_10.42.42.6(pid=22794): Launched 16:31:47.170893 run osmo-stp_10.42.42.5(pid=22791): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22791)] 16:31:47.322721 run osmo-stp_10.42.42.5(pid=22791): stdout: | (launched: 2022-12-09_16:31:45.509054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:47.451957 run osmo-stp_10.42.42.5(pid=22791): stderr: | [0;m[38;5;43m20221209163145702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163145703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163145703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163145703 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163145704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163145704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163145704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:47.579057 run osmo-stp_10.42.42.5(pid=22791): stdout: | (launched: 2022-12-09_16:31:45.509054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:47.700325 run osmo-stp_10.42.42.5(pid=22791): stderr: | [0;m[38;5;43m20221209163145702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163145703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163145703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163145703 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163145704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163145704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163145704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:47.845662 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22791): Process ended prematurely: osmo-stp_10.42.42.5(pid=22791) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22791)] [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:31:47.854529 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 16:31:47.881269 run osmo-hlr_10.42.42.2(pid=22788): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22788)] 16:31:47.928621 run osmo-hlr_10.42.42.2(pid=22788): stdout: | (launched: 2022-12-09_16:31:44.491138) 16:31:47.977412 run osmo-hlr_10.42.42.2(pid=22788): stderr: | [0;m[1;31m20221209163144692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163144692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163144692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163144692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163144692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163144692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163144704 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163144712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163144712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163144712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:48.046123 run osmo-msc_10.42.42.6(pid=22794): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22794)] 16:31:48.093494 run osmo-msc_10.42.42.6(pid=22794): stdout: | (launched: 2022-12-09_16:31:46.625906) 16:31:48.142374 run osmo-msc_10.42.42.6(pid=22794): stderr: | [0;m[38;5;43m20221209163147000 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163147001 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffb4cd89c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163147001 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163147001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163147002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163147002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163147007 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163147008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163147008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163147008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:31:48.191819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22787): Terminating (SIGTERM) 16:31:48.231302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22790): Terminating (SIGTERM) 16:31:48.270798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22793): Terminating (SIGTERM) 16:31:48.310839 --- ParallelTerminationStrategy: PID 22787 died... 16:31:48.329920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22787): Terminated: ok {rc=0} 16:31:48.373917 --- ParallelTerminationStrategy: PID 22790 died... 16:31:48.392453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22790): Terminated: ok {rc=0} 16:31:48.436831 --- ParallelTerminationStrategy: PID 22793 died... 16:31:48.455624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22793): Terminated: ok {rc=0} 16:31:48.538953 bus /sierra_3: Setting Powered False 16:31:49.637594 bus /sierra_3: Setting Powered False 16:31:50.753097 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:31:51.902119 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:51.914805 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:31:51.982567 tst mo_mt_call_osmux.py: using LAC 22306 16:31:52.109529 tst mo_mt_call_osmux.py: using RAC 121 16:31:52.230144 tst mo_mt_call_osmux.py: using CellId 22306 16:31:52.352057 tst mo_mt_call_osmux.py: using BVCI 22307 16:31:52.463546 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:52.475084 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:52.486683 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:52.498046 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:52.509529 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:31:52.520648 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:31:52.641292 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:31:52.763223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:53.269212 run create_hlr_db(pid=22796): Launched 16:31:53.396091 bus /sierra_2: Setting Powered False 16:31:54.460745 run create_hlr_db(pid=22796): Terminated: ok {rc=0} 16:31:54.914793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22798): Launched 16:31:55.242931 run osmo-hlr_10.42.42.2(pid=22799): Launched 16:31:55.368059 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:55.929933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22801): Launched 16:31:56.256151 run osmo-stp_10.42.42.5(pid=22802): Launched 16:31:56.380116 run osmo-msc_10.42.42.6: Starting osmo-msc 16:31:56.967729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22804): Launched 16:31:57.296250 run osmo-msc_10.42.42.6(pid=22805): Launched 16:31:57.480182 run osmo-stp_10.42.42.5(pid=22802): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22802)] 16:31:57.618968 run osmo-stp_10.42.42.5(pid=22802): stdout: | (launched: 2022-12-09_16:31:56.197292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:57.756882 run osmo-stp_10.42.42.5(pid=22802): stderr: | [0;m[38;5;43m20221209163156391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163156391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163156391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163156391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163156392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163156392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163156392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:57.894215 run osmo-stp_10.42.42.5(pid=22802): stdout: | (launched: 2022-12-09_16:31:56.197292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:58.023073 run osmo-stp_10.42.42.5(pid=22802): stderr: | [0;m[38;5;43m20221209163156391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163156391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163156391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163156391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163156392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163156392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163156392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:58.177988 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22802): Process ended prematurely: osmo-stp_10.42.42.5(pid=22802) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22802)] [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:31:58.187520 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:31:58.215922 run osmo-hlr_10.42.42.2(pid=22799): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22799)] 16:31:58.265669 run osmo-hlr_10.42.42.2(pid=22799): stdout: | (launched: 2022-12-09_16:31:55.183152) 16:31:58.317286 run osmo-hlr_10.42.42.2(pid=22799): stderr: | [0;m[1;31m20221209163155382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163155382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163155382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163155382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163155382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163155382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163155396 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163155405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163155405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163155405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:58.389012 run osmo-msc_10.42.42.6(pid=22805): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22805)] 16:31:58.438721 run osmo-msc_10.42.42.6(pid=22805): stdout: | (launched: 2022-12-09_16:31:57.236446) 16:31:58.489978 run osmo-msc_10.42.42.6(pid=22805): stderr: | [0;m[38;5;43m20221209163157557 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163157557 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f32c6662c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163157557 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163157557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163157558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163157558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163157560 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163157560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163157560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163157560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:31:58.541664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22798): Terminating (SIGTERM) 16:31:58.583028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22801): Terminating (SIGTERM) 16:31:58.624569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22804): Terminating (SIGTERM) 16:31:58.666475 --- ParallelTerminationStrategy: PID 22798 died... 16:31:58.686333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22798): Terminated: ok {rc=0} 16:31:58.732257 --- ParallelTerminationStrategy: PID 22801 died... 16:31:58.751588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22801): Terminated: ok {rc=0} 16:31:58.797489 --- ParallelTerminationStrategy: PID 22804 died... 16:31:58.817220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22804): Terminated: ok {rc=0} 16:31:58.905078 bus /sierra_3: Setting Powered False 16:32:00.000923 bus /sierra_3: Setting Powered False 16:32:01.123329 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:32:02.378489 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:32:02.386060 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:32:02.414795 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:32:02.441511 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:32:02.501950 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:32:02.531953 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:32:02.559254 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:32:03.102454 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:32:03.150960 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:32:03.162384 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:32:03.227976 tst mo_mt_call.py: using LAC 22307 16:32:03.346335 tst mo_mt_call.py: using RAC 122 16:32:03.464060 tst mo_mt_call.py: using CellId 22307 16:32:03.584219 tst mo_mt_call.py: using BVCI 22308 16:32:03.694478 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:32:03.705922 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:32:03.717052 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:32:03.728230 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:32:03.739475 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:32:03.750695 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:32:03.871751 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:32:03.988026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:04.465037 run create_hlr_db(pid=22810): Launched 16:32:04.591120 bus /sierra_2: Setting Powered False 16:32:05.655437 run create_hlr_db(pid=22810): Terminated: ok {rc=0} 16:32:06.091882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22812): Launched 16:32:06.420406 run osmo-hlr_10.42.42.2(pid=22813): Launched 16:32:06.544719 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:07.105448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22815): Launched 16:32:07.431911 run osmo-stp_10.42.42.5(pid=22816): Launched 16:32:07.558624 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:08.149898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22818): Launched 16:32:08.478172 run osmo-msc_10.42.42.6(pid=22819): Launched 16:32:08.662381 run osmo-stp_10.42.42.5(pid=22816): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22816)] 16:32:08.799596 run osmo-stp_10.42.42.5(pid=22816): stdout: | (launched: 2022-12-09_16:32:07.372693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:08.938725 run osmo-stp_10.42.42.5(pid=22816): stderr: | [0;m[38;5;43m20221209163207563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163207563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163207563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163207564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163207566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163207566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163207566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:09.075880 run osmo-stp_10.42.42.5(pid=22816): stdout: | (launched: 2022-12-09_16:32:07.372693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:09.205462 run osmo-stp_10.42.42.5(pid=22816): stderr: | [0;m[38;5;43m20221209163207563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163207563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163207563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163207564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163207566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163207566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163207566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:09.360792 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22816): Process ended prematurely: osmo-stp_10.42.42.5(pid=22816) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22816)] [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:32:09.370370 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:32:09.399200 run osmo-hlr_10.42.42.2(pid=22813): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22813)] 16:32:09.449331 run osmo-hlr_10.42.42.2(pid=22813): stdout: | (launched: 2022-12-09_16:32:06.360694) 16:32:09.501219 run osmo-hlr_10.42.42.2(pid=22813): stderr: | [0;m[1;31m20221209163206558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163206558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163206558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163206558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163206558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163206558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163206570 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163206579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163206579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163206579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:09.574193 run osmo-msc_10.42.42.6(pid=22819): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22819)] 16:32:09.624422 run osmo-msc_10.42.42.6(pid=22819): stdout: | (launched: 2022-12-09_16:32:08.418347) 16:32:09.676170 run osmo-msc_10.42.42.6(pid=22819): stderr: | [0;m[38;5;43m20221209163208740 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163208741 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbddd85fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163208741 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163208741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163208741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163208741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163208743 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163208743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163208743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163208743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:09.728359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22812): Terminating (SIGTERM) 16:32:09.770075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22815): Terminating (SIGTERM) 16:32:09.811944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22818): Terminating (SIGTERM) 16:32:09.854612 --- ParallelTerminationStrategy: PID 22812 died... 16:32:09.874732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22812): Terminated: ok {rc=0} 16:32:09.921386 --- ParallelTerminationStrategy: PID 22815 died... 16:32:09.941060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22815): Terminated: ok {rc=0} 16:32:09.987595 --- ParallelTerminationStrategy: PID 22818 died... 16:32:10.007285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22818): Terminated: ok {rc=0} 16:32:10.094493 bus /sierra_3: Setting Powered False 16:32:11.192425 bus /sierra_3: Setting Powered False 16:32:12.308793 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:32:13.457880 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:32:13.470764 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:32:13.543510 tst mo_mt_call_osmux.py: using LAC 22308 16:32:13.671696 tst mo_mt_call_osmux.py: using RAC 123 16:32:13.798150 tst mo_mt_call_osmux.py: using CellId 22308 16:32:13.928775 tst mo_mt_call_osmux.py: using BVCI 22309 16:32:14.047360 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:32:14.059484 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:32:14.071395 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:32:14.083716 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:32:14.096213 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:32:14.109359 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:32:14.227406 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:32:14.348500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:14.854439 run create_hlr_db(pid=22821): Launched 16:32:14.979841 bus /sierra_2: Setting Powered False 16:32:16.045345 run create_hlr_db(pid=22821): Terminated: ok {rc=0} 16:32:16.508321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22823): Launched 16:32:16.850256 run osmo-hlr_10.42.42.2(pid=22824): Launched 16:32:17.114991 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:17.651427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22826): Launched 16:32:17.956560 run osmo-stp_10.42.42.5(pid=22827): Launched 16:32:18.072250 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:18.619560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22829): Launched 16:32:18.924714 run osmo-msc_10.42.42.6(pid=22830): Launched 16:32:19.094013 run osmo-stp_10.42.42.5(pid=22827): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22827)] 16:32:19.221235 run osmo-stp_10.42.42.5(pid=22827): stdout: | (launched: 2022-12-09_16:32:17.900719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:19.348841 run osmo-stp_10.42.42.5(pid=22827): stderr: | [0;m[38;5;43m20221209163218074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163218074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163218074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163218074 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163218075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163218075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163218075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:19.474964 run osmo-stp_10.42.42.5(pid=22827): stdout: | (launched: 2022-12-09_16:32:17.900719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:19.595698 run osmo-stp_10.42.42.5(pid=22827): stderr: | [0;m[38;5;43m20221209163218074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163218074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163218074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163218074 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163218075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163218075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163218075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:19.741691 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22827): Process ended prematurely: osmo-stp_10.42.42.5(pid=22827) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22827)] [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:32:19.750644 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:32:19.777912 run osmo-hlr_10.42.42.2(pid=22824): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22824)] 16:32:19.825585 run osmo-hlr_10.42.42.2(pid=22824): stdout: | (launched: 2022-12-09_16:32:16.787935) 16:32:19.875098 run osmo-hlr_10.42.42.2(pid=22824): stderr: | [0;m[1;31m20221209163217050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163217050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163217050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163217050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163217050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163217050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163217070 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163217084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163217084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163217093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:19.944223 run osmo-msc_10.42.42.6(pid=22830): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22830)] 16:32:19.991804 run osmo-msc_10.42.42.6(pid=22830): stdout: | (launched: 2022-12-09_16:32:18.868345) 16:32:20.041242 run osmo-msc_10.42.42.6(pid=22830): stderr: | [0;m[38;5;43m20221209163219140 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163219140 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f534215ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163219140 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163219140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163219140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163219140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163219142 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163219143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163219144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163219144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:20.090918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22823): Terminating (SIGTERM) 16:32:20.130557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22826): Terminating (SIGTERM) 16:32:20.170543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22829): Terminating (SIGTERM) 16:32:20.210947 --- ParallelTerminationStrategy: PID 22823 died... 16:32:20.230265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22823): Terminated: ok {rc=0} 16:32:20.274798 --- ParallelTerminationStrategy: PID 22826 died... 16:32:20.293726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22826): Terminated: ok {rc=0} 16:32:20.337993 --- ParallelTerminationStrategy: PID 22829 died... 16:32:20.356884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22829): Terminated: ok {rc=0} 16:32:20.443699 bus /sierra_3: Setting Powered False 16:32:21.542706 bus /sierra_3: Setting Powered False 16:32:22.657330 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:32:23.908293 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:32:23.914044 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:32:23.942918 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:32:23.969729 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:32:24.022810 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:32:24.051737 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:32:24.077889 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:32:24.627813 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:32:24.676723 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:24.687944 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:32:24.753752 tst mo_mt_call.py: using LAC 22309 16:32:24.884168 tst mo_mt_call.py: using RAC 124 16:32:25.012633 tst mo_mt_call.py: using CellId 22309 16:32:25.141161 tst mo_mt_call.py: using BVCI 22310 16:32:25.259150 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:25.271102 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:25.282734 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:25.294770 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:25.306732 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:25.318458 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:32:25.439940 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:32:25.561287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:26.064888 run create_hlr_db(pid=22835): Launched 16:32:26.189252 bus /sierra_2: Setting Powered False 16:32:27.253470 run create_hlr_db(pid=22835): Terminated: ok {rc=0} 16:32:27.687818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22837): Launched 16:32:28.016476 run osmo-hlr_10.42.42.2(pid=22838): Launched 16:32:28.140786 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:28.700593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22840): Launched 16:32:29.026475 run osmo-stp_10.42.42.5(pid=22841): Launched 16:32:29.150014 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:29.736476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22843): Launched 16:32:30.064071 run osmo-msc_10.42.42.6(pid=22844): Launched 16:32:30.245530 run osmo-stp_10.42.42.5(pid=22841): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22841)] 16:32:30.383071 run osmo-stp_10.42.42.5(pid=22841): stdout: | (launched: 2022-12-09_16:32:28.967454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:30.521153 run osmo-stp_10.42.42.5(pid=22841): stderr: | [0;m[38;5;43m20221209163229161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163229161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163229161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163229162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163229162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163229162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163229162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:30.658322 run osmo-stp_10.42.42.5(pid=22841): stdout: | (launched: 2022-12-09_16:32:28.967454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:30.787848 run osmo-stp_10.42.42.5(pid=22841): stderr: | [0;m[38;5;43m20221209163229161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163229161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163229161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163229162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163229162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163229162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163229162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:30.953594 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22841): Process ended prematurely: osmo-stp_10.42.42.5(pid=22841) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22841)] [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:32:30.963979 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:32:30.994639 run osmo-hlr_10.42.42.2(pid=22838): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22838)] 16:32:31.046295 run osmo-hlr_10.42.42.2(pid=22838): stdout: | (launched: 2022-12-09_16:32:27.957158) 16:32:31.099820 run osmo-hlr_10.42.42.2(pid=22838): stderr: | [0;m[1;31m20221209163228154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163228154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163228154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163228154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163228154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163228154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163228166 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163228175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163228175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163228175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:31.173657 run osmo-msc_10.42.42.6(pid=22844): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22844)] 16:32:31.225463 run osmo-msc_10.42.42.6(pid=22844): stdout: | (launched: 2022-12-09_16:32:30.004302) 16:32:31.278705 run osmo-msc_10.42.42.6(pid=22844): stderr: | [0;m[38;5;43m20221209163230326 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163230327 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f639df64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163230327 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163230327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163230327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163230327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163230329 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163230329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163230329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163230329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:31.332787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22837): Terminating (SIGTERM) 16:32:31.376846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22840): Terminating (SIGTERM) 16:32:31.421763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22843): Terminating (SIGTERM) 16:32:31.465762 --- ParallelTerminationStrategy: PID 22837 died... 16:32:31.486224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22837): Terminated: ok {rc=0} 16:32:31.534848 --- ParallelTerminationStrategy: PID 22840 died... 16:32:31.555404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22840): Terminated: ok {rc=0} 16:32:31.604065 --- ParallelTerminationStrategy: PID 22843 died... 16:32:31.624568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22843): Terminated: ok {rc=0} 16:32:31.714681 bus /sierra_3: Setting Powered False 16:32:32.810585 bus /sierra_3: Setting Powered False 16:32:33.924747 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:32:35.070675 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:35.082792 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:32:35.149109 tst mo_mt_call_osmux.py: using LAC 22310 16:32:35.267838 tst mo_mt_call_osmux.py: using RAC 125 16:32:35.387062 tst mo_mt_call_osmux.py: using CellId 22310 16:32:35.507298 tst mo_mt_call_osmux.py: using BVCI 22311 16:32:35.618529 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:35.629848 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:35.640802 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:35.651796 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:35.662863 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:32:35.673824 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:32:35.793908 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:32:35.914815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:36.384836 run create_hlr_db(pid=22846): Launched 16:32:36.508426 bus /sierra_2: Setting Powered False 16:32:37.569459 run create_hlr_db(pid=22846): Terminated: ok {rc=0} 16:32:38.014444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22848): Launched 16:32:38.339911 run osmo-hlr_10.42.42.2(pid=22849): Launched 16:32:38.464502 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:39.023564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22851): Launched 16:32:39.350903 run osmo-stp_10.42.42.5(pid=22852): Launched 16:32:39.475110 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:40.064718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22854): Launched 16:32:40.391907 run osmo-msc_10.42.42.6(pid=22855): Launched 16:32:40.576278 run osmo-stp_10.42.42.5(pid=22852): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22852)] 16:32:40.714515 run osmo-stp_10.42.42.5(pid=22852): stdout: | (launched: 2022-12-09_16:32:39.291470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:40.853843 run osmo-stp_10.42.42.5(pid=22852): stderr: | [0;m[38;5;43m20221209163239483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163239484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163239484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163239484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163239485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163239485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163239485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:40.991317 run osmo-stp_10.42.42.5(pid=22852): stdout: | (launched: 2022-12-09_16:32:39.291470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:41.120870 run osmo-stp_10.42.42.5(pid=22852): stderr: | [0;m[38;5;43m20221209163239483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163239484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163239484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163239484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163239485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163239485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163239485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:41.276469 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22852): Process ended prematurely: osmo-stp_10.42.42.5(pid=22852) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22852)] [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:32:41.286198 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:32:41.314825 run osmo-hlr_10.42.42.2(pid=22849): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22849)] 16:32:41.364828 run osmo-hlr_10.42.42.2(pid=22849): stdout: | (launched: 2022-12-09_16:32:38.280878) 16:32:41.416496 run osmo-hlr_10.42.42.2(pid=22849): stderr: | [0;m[1;31m20221209163238480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163238480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163238480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163238480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163238481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163238481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163238493 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163238501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163238501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163238501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:41.488395 run osmo-msc_10.42.42.6(pid=22855): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22855)] 16:32:41.538025 run osmo-msc_10.42.42.6(pid=22855): stdout: | (launched: 2022-12-09_16:32:40.332183) 16:32:41.589705 run osmo-msc_10.42.42.6(pid=22855): stderr: | [0;m[38;5;43m20221209163240656 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163240657 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f653266ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163240657 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163240657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163240657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163240657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163240659 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163240659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163240659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163240659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:41.641701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22848): Terminating (SIGTERM) 16:32:41.683401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22851): Terminating (SIGTERM) 16:32:41.725242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22854): Terminating (SIGTERM) 16:32:41.767475 --- ParallelTerminationStrategy: PID 22848 died... 16:32:41.787528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22848): Terminated: ok {rc=0} 16:32:41.834743 --- ParallelTerminationStrategy: PID 22851 died... 16:32:41.854456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22851): Terminated: ok {rc=0} 16:32:41.900924 --- ParallelTerminationStrategy: PID 22854 died... 16:32:41.920515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22854): Terminated: ok {rc=0} 16:32:42.008164 bus /sierra_3: Setting Powered False 16:32:43.106739 bus /sierra_3: Setting Powered False 16:32:44.221077 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 16:32:45.467636 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:32:45.472431 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:32:45.503369 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:32:45.531108 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 16:32:45.618331 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:32:45.648474 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:32:45.676133 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 16:32:46.260560 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2361 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 16:32:46.267614 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:46.279748 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:32:46.329907 tst emergency_mo_mt_call.py: using LAC 22311 16:32:46.491332 tst emergency_mo_mt_call.py: using RAC 126 16:32:46.613206 tst emergency_mo_mt_call.py: using CellId 22311 16:32:46.750417 tst emergency_mo_mt_call.py: using BVCI 22312 16:32:46.861849 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:46.873422 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:46.884857 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:46.896566 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:46.907975 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:46.919562 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:32:47.039239 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:32:47.176071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:47.643181 run create_hlr_db(pid=22860): Launched 16:32:47.767117 bus /sierra_2: Setting Powered False 16:32:48.827099 run create_hlr_db(pid=22860): Terminated: ok {rc=0} 16:32:49.265666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22863): Launched 16:32:49.570308 run osmo-hlr_10.42.42.2(pid=22864): Launched 16:32:49.685155 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:50.196565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22866): Launched 16:32:50.494485 run osmo-stp_10.42.42.5(pid=22867): Launched 16:32:50.617643 tst emergency_mo_mt_call.py: using MSISDN 7269 16:32:50.768335 run osmo-msc_10.42.42.6: Starting osmo-msc 16:32:51.306076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22869): Launched 16:32:51.605627 run osmo-msc_10.42.42.6(pid=22870): Launched 16:32:51.771940 run osmo-stp_10.42.42.5(pid=22867): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22867)] 16:32:51.898845 run osmo-stp_10.42.42.5(pid=22867): stdout: | (launched: 2022-12-09_16:32:50.439195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:52.024368 run osmo-stp_10.42.42.5(pid=22867): stderr: | [0;m[38;5;43m20221209163250610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163250610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163250611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163250611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163250611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163250611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163250612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:52.147715 run osmo-stp_10.42.42.5(pid=22867): stdout: | (launched: 2022-12-09_16:32:50.439195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:52.265943 run osmo-stp_10.42.42.5(pid=22867): stderr: | [0;m[38;5;43m20221209163250610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163250610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163250611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163250611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163250611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163250611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163250612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:52.407524 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22867): Process ended prematurely: osmo-stp_10.42.42.5(pid=22867) [trial-2361↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22867)] [trial-2361↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 16:32:52.415604 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 16:32:52.441634 run osmo-hlr_10.42.42.2(pid=22864): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22864)] 16:32:52.488831 run osmo-hlr_10.42.42.2(pid=22864): stdout: | (launched: 2022-12-09_16:32:49.515531) 16:32:52.537974 run osmo-hlr_10.42.42.2(pid=22864): stderr: | [0;m[1;31m20221209163249690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163249690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163249690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163249690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163249690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163249690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163249702 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163249713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163249714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163249714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:52.606377 run osmo-msc_10.42.42.6(pid=22870): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22870)] 16:32:52.653582 run osmo-msc_10.42.42.6(pid=22870): stdout: | (launched: 2022-12-09_16:32:51.550678) 16:32:52.702472 run osmo-msc_10.42.42.6(pid=22870): stderr: | [0;m[38;5;43m20221209163251823 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163251823 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd26641fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163251823 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163251823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163251824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163251824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163251826 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163251826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163251826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163251826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:32:52.751625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22863): Terminating (SIGTERM) 16:32:52.790501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22866): Terminating (SIGTERM) 16:32:52.829496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22869): Terminating (SIGTERM) 16:32:52.868885 --- ParallelTerminationStrategy: PID 22863 died... 16:32:52.887773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22863): Terminated: ok {rc=0} 16:32:52.931218 --- ParallelTerminationStrategy: PID 22866 died... 16:32:52.949734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22866): Terminated: ok {rc=0} 16:32:52.993204 --- ParallelTerminationStrategy: PID 22869 died... 16:32:53.011607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22869): Terminated: ok {rc=0} 16:32:53.094196 bus /sierra_3: Setting Powered False 16:32:54.192054 bus /sierra_3: Setting Powered False 16:32:55.307785 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 16:32:56.392755 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:56.405213 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:32:56.452041 tst emergency_preemptive_call.py: using LAC 22312 16:32:56.576762 tst emergency_preemptive_call.py: using RAC 127 16:32:56.700201 tst emergency_preemptive_call.py: using CellId 22312 16:32:56.817034 tst emergency_preemptive_call.py: using BVCI 22313 16:32:56.924215 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:56.935295 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:56.946108 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:56.956845 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:56.967751 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:32:56.978350 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:32:57.097948 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:32:57.216587 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:32:57.335847 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:32:57.453803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:57.950300 run create_hlr_db(pid=22872): Launched 16:32:58.075903 bus /sierra_2: Setting Powered False 16:32:59.139047 run create_hlr_db(pid=22872): Terminated: ok {rc=0} 16:32:59.585789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22874): Launched 16:32:59.908268 run osmo-hlr_10.42.42.2(pid=22875): Launched 16:33:00.033078 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:00.583486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22877): Launched 16:33:00.933700 run osmo-stp_10.42.42.5(pid=22878): Launched 16:33:01.093461 tst emergency_preemptive_call.py: using MSISDN 7270 16:33:01.417886 run osmo-msc_10.42.42.6: Starting osmo-msc 16:33:02.112582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22881): Launched 16:33:02.447038 run osmo-msc_10.42.42.6(pid=22882): Launched 16:33:02.627353 run osmo-stp_10.42.42.5(pid=22878): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22878)] 16:33:02.762854 run osmo-stp_10.42.42.5(pid=22878): stdout: | (launched: 2022-12-09_16:33:00.851098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:02.899262 run osmo-stp_10.42.42.5(pid=22878): stderr: | [0;m[38;5;43m20221209163301199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163301200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163301202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163301202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163301203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163301203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163301203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:03.034389 run osmo-stp_10.42.42.5(pid=22878): stdout: | (launched: 2022-12-09_16:33:00.851098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:03.162288 run osmo-stp_10.42.42.5(pid=22878): stderr: | [0;m[38;5;43m20221209163301199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163301200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163301202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163301202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163301203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163301203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163301203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:03.314963 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=22878): Process ended prematurely: osmo-stp_10.42.42.5(pid=22878) [trial-2361↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22878)] [trial-2361↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 16:33:03.323959 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 16:33:03.352059 run osmo-hlr_10.42.42.2(pid=22875): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22875)] 16:33:03.402163 run osmo-hlr_10.42.42.2(pid=22875): stdout: | (launched: 2022-12-09_16:32:59.849555) 16:33:03.453925 run osmo-hlr_10.42.42.2(pid=22875): stderr: | [0;m[1;31m20221209163300049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163300049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163300049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163300049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163300049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163300049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163300061 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163300069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163300070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163300070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:03.526152 run osmo-msc_10.42.42.6(pid=22882): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22882)] 16:33:03.575882 run osmo-msc_10.42.42.6(pid=22882): stdout: | (launched: 2022-12-09_16:33:02.388353) 16:33:03.627370 run osmo-msc_10.42.42.6(pid=22882): stderr: | [0;m[38;5;43m20221209163302707 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163302707 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2a16189c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163302707 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163302707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163302707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163302708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163302709 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163302710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163302710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163302710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:33:03.679279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22874): Terminating (SIGTERM) 16:33:03.721024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22877): Terminating (SIGTERM) 16:33:03.762847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22881): Terminating (SIGTERM) 16:33:03.804896 --- ParallelTerminationStrategy: PID 22874 died... 16:33:03.825033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22874): Terminated: ok {rc=0} 16:33:03.871716 --- ParallelTerminationStrategy: PID 22877 died... 16:33:03.891339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22877): Terminated: ok {rc=0} 16:33:03.937628 --- ParallelTerminationStrategy: PID 22881 died... 16:33:03.957232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22881): Terminated: ok {rc=0} 16:33:04.045331 bus /sierra_9: Setting Powered False 16:33:05.143555 bus /sierra_9: Setting Powered False 16:33:06.260929 bus /sierra_8: Setting Powered False 16:33:07.358376 bus /sierra_8: Setting Powered False 16:33:08.473607 bus /sierra_3: Setting Powered False 16:33:09.573334 bus /sierra_3: Setting Powered False 16:33:10.687990 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 16:33:11.965482 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:33:11.970308 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:33:12.000862 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 16:33:12.040729 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 16:33:12.129447 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:33:12.159551 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 16:33:12.199145 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 16:33:12.793459 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 16:33:12.847075 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:12.858853 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:33:12.904923 tst cs_paging_gprs_active.py: using LAC 22313 16:33:13.032921 tst cs_paging_gprs_active.py: using RAC 128 16:33:13.159122 tst cs_paging_gprs_active.py: using CellId 22313 16:33:13.286681 tst cs_paging_gprs_active.py: using BVCI 22314 16:33:13.404512 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:13.415870 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:13.427068 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:13.438467 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:13.449722 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:13.460873 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:13.472284 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:13.483553 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:13.494898 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:33:13.613097 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:33:13.733649 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:33:13.955711 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:14.285092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22887): Launched 16:33:14.570256 run iperf3-srv_10.42.42.10(pid=22888): Launched 16:33:14.694312 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:33:14.915033 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:15.242759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22889): Launched 16:33:15.529078 run iperf3-srv_10.42.42.10(pid=22890): Launched 16:33:15.651450 tst cs_paging_gprs_active.py:38: start network... 16:33:15.875957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:16.376010 run create_hlr_db(pid=22891): Launched 16:33:16.538526 bus /sierra_2: Setting Powered False 16:33:17.599865 run create_hlr_db(pid=22891): Terminated: ok {rc=0} 16:33:18.023602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22893): Launched 16:33:18.327777 run osmo-hlr_10.42.42.2(pid=22894): Launched 16:33:18.443040 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:18.963031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22896): Launched 16:33:19.269504 run osmo-stp_10.42.42.5(pid=22897): Launched 16:33:19.385727 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:33:19.908042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22899): Launched 16:33:20.025673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:33:20.284429 run patchelf(pid=22900): Launched 16:33:20.454624 run osmo-stp_10.42.42.5(pid=22897): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22897)] 16:33:20.583482 run osmo-stp_10.42.42.5(pid=22897): stdout: | (launched: 2022-12-09_16:33:19.213538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:20.714171 run osmo-stp_10.42.42.5(pid=22897): stderr: | [0;m[38;5;43m20221209163319383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163319383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163319384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163319384 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163319385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163319385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163319385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:20.844625 run osmo-stp_10.42.42.5(pid=22897): stdout: | (launched: 2022-12-09_16:33:19.213538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:20.968431 run osmo-stp_10.42.42.5(pid=22897): stderr: | [0;m[38;5;43m20221209163319383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163319383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163319384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163319384 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163319385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163319385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163319385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:21.115477 run patchelf(pid=22900): Terminating (SIGINT) 16:33:21.286374 run patchelf(pid=22900): Terminated: ok {rc=0} 16:33:21.409364 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22897): Process ended prematurely: osmo-stp_10.42.42.5(pid=22897) [trial-2361↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22897)] [trial-2361↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 16:33:21.418787 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 16:33:21.445835 run osmo-hlr_10.42.42.2(pid=22894): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22894)] 16:33:21.493047 run osmo-hlr_10.42.42.2(pid=22894): stdout: | (launched: 2022-12-09_16:33:18.272148) 16:33:21.541869 run osmo-hlr_10.42.42.2(pid=22894): stderr: | [0;m[1;31m20221209163318451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163318451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163318451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163318451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163318451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163318451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163318463 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163318474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163318474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163318474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:21.591148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22887): Terminating (SIGTERM) 16:33:21.630735 run iperf3-srv_10.42.42.10(pid=22888): Terminating (SIGTERM) 16:33:21.669957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22889): Terminating (SIGTERM) 16:33:21.709327 run iperf3-srv_10.42.42.10(pid=22890): Terminating (SIGTERM) 16:33:21.748457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22893): Terminating (SIGTERM) 16:33:21.787688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22896): Terminating (SIGTERM) 16:33:21.827074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22899): Terminating (SIGTERM) 16:33:21.866750 --- ParallelTerminationStrategy: PID 22887 died... 16:33:21.886222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22887): Terminated: ok {rc=0} 16:33:21.929969 --- ParallelTerminationStrategy: PID 22888 died... 16:33:21.948343 run iperf3-srv_10.42.42.10(pid=22888): Terminated {rc=256} 16:33:21.992418 --- ParallelTerminationStrategy: PID 22889 died... 16:33:22.011133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22889): Terminated: ok {rc=0} 16:33:22.054651 --- ParallelTerminationStrategy: PID 22890 died... 16:33:22.073220 run iperf3-srv_10.42.42.10(pid=22890): Terminated {rc=256} 16:33:22.117317 --- ParallelTerminationStrategy: PID 22893 died... 16:33:22.135828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22893): Terminated: ok {rc=0} 16:33:22.179345 --- ParallelTerminationStrategy: PID 22896 died... 16:33:22.198005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22896): Terminated: ok {rc=0} 16:33:22.241565 --- ParallelTerminationStrategy: PID 22899 died... 16:33:22.260168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22899): Terminated: ok {rc=0} 16:33:22.345341 bus /gobi_0: Setting Powered False 16:33:23.444766 bus /gobi_0: Setting Powered False 16:33:24.560122 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 16:33:25.706031 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:25.717778 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:33:25.765344 tst iperf3.py: using LAC 22314 16:33:25.885436 tst iperf3.py: using RAC 129 16:33:26.003265 tst iperf3.py: using CellId 22314 16:33:26.123207 tst iperf3.py: using BVCI 22315 16:33:26.232396 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:26.243260 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:26.253993 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:26.264561 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:26.275398 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:26.285907 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:26.296566 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:26.307073 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:26.319086 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:33:26.435679 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:33:26.639172 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:26.944089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22902): Launched 16:33:27.210904 run iperf3-srv_10.42.42.10(pid=22903): Launched 16:33:27.326855 tst iperf3.py:8: start network... 16:33:27.531119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:27.999935 run create_hlr_db(pid=22904): Launched 16:33:28.123458 bus /gobi_6: Setting Powered False 16:33:29.183803 run create_hlr_db(pid=22904): Terminated: ok {rc=0} 16:33:29.607046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22906): Launched 16:33:29.912156 run osmo-hlr_10.42.42.2(pid=22907): Launched 16:33:30.027132 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:30.547923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22909): Launched 16:33:30.869219 run osmo-stp_10.42.42.5(pid=22910): Launched 16:33:31.088164 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:33:31.757452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22912): Launched 16:33:31.888826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:33:32.153466 run patchelf(pid=22913): Launched 16:33:32.340651 run osmo-stp_10.42.42.5(pid=22910): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22910)] 16:33:32.470169 run osmo-stp_10.42.42.5(pid=22910): stdout: | (launched: 2022-12-09_16:33:30.796319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:32.600882 run osmo-stp_10.42.42.5(pid=22910): stderr: | [0;m[38;5;43m20221209163331111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163331111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163331111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163331112 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163331118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163331118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163331118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:32.731614 run osmo-stp_10.42.42.5(pid=22910): stdout: | (launched: 2022-12-09_16:33:30.796319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:32.856163 run osmo-stp_10.42.42.5(pid=22910): stderr: | [0;m[38;5;43m20221209163331111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163331111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163331111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163331112 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163331118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163331118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163331118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:33.003533 run patchelf(pid=22913): Terminating (SIGINT) 16:33:33.175184 run patchelf(pid=22913): Terminated: ok {rc=0} 16:33:33.298877 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22910): Process ended prematurely: osmo-stp_10.42.42.5(pid=22910) [trial-2361↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22910)] [trial-2361↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 16:33:33.308474 tst iperf3.py:8: Test FAILED (7.6 sec) 16:33:33.335808 run osmo-hlr_10.42.42.2(pid=22907): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22907)] 16:33:33.382802 run osmo-hlr_10.42.42.2(pid=22907): stdout: | (launched: 2022-12-09_16:33:29.856121) 16:33:33.431883 run osmo-hlr_10.42.42.2(pid=22907): stderr: | [0;m[1;31m20221209163330035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163330035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163330035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163330035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163330035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163330036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163330048 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163330058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163330058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163330059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:33.481714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22902): Terminating (SIGTERM) 16:33:33.521676 run iperf3-srv_10.42.42.10(pid=22903): Terminating (SIGTERM) 16:33:33.561407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22906): Terminating (SIGTERM) 16:33:33.600809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22909): Terminating (SIGTERM) 16:33:33.641065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22912): Terminating (SIGTERM) 16:33:33.681429 --- ParallelTerminationStrategy: PID 22902 died... 16:33:33.700682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22902): Terminated: ok {rc=0} 16:33:33.745153 --- ParallelTerminationStrategy: PID 22903 died... 16:33:33.763785 run iperf3-srv_10.42.42.10(pid=22903): Terminated {rc=256} 16:33:33.807811 --- ParallelTerminationStrategy: PID 22906 died... 16:33:33.826634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22906): Terminated: ok {rc=0} 16:33:33.870670 --- ParallelTerminationStrategy: PID 22909 died... 16:33:33.889467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22909): Terminated: ok {rc=0} 16:33:33.933444 --- ParallelTerminationStrategy: PID 22912 died... 16:33:33.952052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22912): Terminated: ok {rc=0} 16:33:34.037572 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 16:33:35.184792 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:35.196464 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:33:35.241715 tst iperf3m4.py: using LAC 22315 16:33:35.361765 tst iperf3m4.py: using RAC 130 16:33:35.482329 tst iperf3m4.py: using CellId 22315 16:33:35.603128 tst iperf3m4.py: using BVCI 22316 16:33:35.714391 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:35.725271 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:35.735846 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:35.746478 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:35.757039 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:35.767496 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:35.778486 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:35.788907 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:35.799556 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:33:35.921875 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:33:36.043424 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:33:36.161801 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:33:36.286276 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:33:36.491453 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:36.798069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22914): Launched 16:33:37.062828 run iperf3-srv_10.42.42.10(pid=22915): Launched 16:33:37.176863 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:33:37.381016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:37.687151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22916): Launched 16:33:37.952307 run iperf3-srv_10.42.42.10(pid=22917): Launched 16:33:38.066120 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:33:38.276409 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:38.605105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22918): Launched 16:33:38.889610 run iperf3-srv_10.42.42.10(pid=22919): Launched 16:33:39.013350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:33:39.233740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:39.561524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22920): Launched 16:33:39.846170 run iperf3-srv_10.42.42.10(pid=22921): Launched 16:33:39.969600 tst iperf3m4.py:8: start network... 16:33:40.191017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:40.696395 run create_hlr_db(pid=22922): Launched 16:33:40.821761 bus /gobi_6: Setting Powered False 16:33:41.887285 run create_hlr_db(pid=22922): Terminated: ok {rc=0} 16:33:42.341297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22924): Launched 16:33:42.669747 run osmo-hlr_10.42.42.2(pid=22925): Launched 16:33:42.796191 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:43.462863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22927): Launched 16:33:43.782975 run osmo-stp_10.42.42.5(pid=22928): Launched 16:33:43.907136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:33:44.461822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22930): Launched 16:33:44.585172 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:33:44.854828 run patchelf(pid=22931): Launched 16:33:45.035442 run osmo-stp_10.42.42.5(pid=22928): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22928)] 16:33:45.172024 run osmo-stp_10.42.42.5(pid=22928): stdout: | (launched: 2022-12-09_16:33:43.724743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:45.309579 run osmo-stp_10.42.42.5(pid=22928): stderr: | [0;m[38;5;43m20221209163343934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163343934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163343935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163343935 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163343936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163343936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163343936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:45.447283 run osmo-stp_10.42.42.5(pid=22928): stdout: | (launched: 2022-12-09_16:33:43.724743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:45.578569 run osmo-stp_10.42.42.5(pid=22928): stderr: | [0;m[38;5;43m20221209163343934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163343934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163343935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163343935 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163343936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163343936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163343936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:45.734274 run patchelf(pid=22931): Terminating (SIGINT) 16:33:45.943399 run patchelf(pid=22931): Terminated: ok {rc=0} 16:33:46.069952 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22928): Process ended prematurely: osmo-stp_10.42.42.5(pid=22928) [trial-2361↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22928)] [trial-2361↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 16:33:46.080097 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:33:46.109202 run osmo-hlr_10.42.42.2(pid=22925): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22925)] 16:33:46.157892 run osmo-hlr_10.42.42.2(pid=22925): stdout: | (launched: 2022-12-09_16:33:42.609684) 16:33:46.207832 run osmo-hlr_10.42.42.2(pid=22925): stderr: | [0;m[1;31m20221209163342804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163342804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163342804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163342804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163342804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163342804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163342819 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163342829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163342830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163342830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:46.258917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22914): Terminating (SIGTERM) 16:33:46.301104 run iperf3-srv_10.42.42.10(pid=22915): Terminating (SIGTERM) 16:33:46.343117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22916): Terminating (SIGTERM) 16:33:46.384465 run iperf3-srv_10.42.42.10(pid=22917): Terminating (SIGTERM) 16:33:46.427651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22918): Terminating (SIGTERM) 16:33:46.468450 run iperf3-srv_10.42.42.10(pid=22919): Terminating (SIGTERM) 16:33:46.511713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22920): Terminating (SIGTERM) 16:33:46.553528 run iperf3-srv_10.42.42.10(pid=22921): Terminating (SIGTERM) 16:33:46.597584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22924): Terminating (SIGTERM) 16:33:46.640016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22927): Terminating (SIGTERM) 16:33:46.683820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22930): Terminating (SIGTERM) 16:33:46.726895 --- ParallelTerminationStrategy: PID 22914 died... 16:33:46.746547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22914): Terminated: ok {rc=0} 16:33:46.792825 --- ParallelTerminationStrategy: PID 22915 died... 16:33:46.813460 run iperf3-srv_10.42.42.10(pid=22915): Terminated {rc=256} 16:33:46.858007 --- ParallelTerminationStrategy: PID 22916 died... 16:33:46.876894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22916): Terminated: ok {rc=0} 16:33:46.922333 --- ParallelTerminationStrategy: PID 22917 died... 16:33:46.941135 run iperf3-srv_10.42.42.10(pid=22917): Terminated {rc=256} 16:33:46.986201 --- ParallelTerminationStrategy: PID 22918 died... 16:33:47.006240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22918): Terminated: ok {rc=0} 16:33:47.051767 --- ParallelTerminationStrategy: PID 22919 died... 16:33:47.070805 run iperf3-srv_10.42.42.10(pid=22919): Terminated {rc=256} 16:33:47.115405 --- ParallelTerminationStrategy: PID 22920 died... 16:33:47.134362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22920): Terminated: ok {rc=0} 16:33:47.179442 --- ParallelTerminationStrategy: PID 22921 died... 16:33:47.198721 run iperf3-srv_10.42.42.10(pid=22921): Terminated {rc=256} 16:33:47.243749 --- ParallelTerminationStrategy: PID 22924 died... 16:33:47.262544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22924): Terminated: ok {rc=0} 16:33:47.306184 --- ParallelTerminationStrategy: PID 22927 died... 16:33:47.324620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22927): Terminated: ok {rc=0} 16:33:47.368527 --- ParallelTerminationStrategy: PID 22930 died... 16:33:47.387186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22930): Terminated: ok {rc=0} 16:33:47.472249 bus /gobi_4: Setting Powered False 16:33:48.570308 bus /gobi_4: Setting Powered False 16:33:49.685562 bus /gobi_1: Setting Powered False 16:33:50.783203 bus /gobi_1: Setting Powered False 16:33:51.897290 bus /gobi_0: Setting Powered False 16:33:52.995044 bus /gobi_0: Setting Powered False 16:33:54.110430 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 16:33:55.211980 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:55.223564 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:33:55.271904 tst ping.py: using LAC 22316 16:33:55.386687 tst ping.py: using RAC 131 16:33:55.499744 tst ping.py: using CellId 22316 16:33:55.613390 tst ping.py: using BVCI 22317 16:33:55.719241 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:55.729982 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:55.740510 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:55.751165 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:55.761741 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:55.772226 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:55.782885 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:33:55.793432 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:33:55.906202 tst ping.py:19: start network... 16:33:56.103204 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:56.557191 run create_hlr_db(pid=22932): Launched 16:33:56.677646 bus /gobi_6: Setting Powered False 16:33:57.736451 run create_hlr_db(pid=22932): Terminated: ok {rc=0} 16:33:58.147114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22934): Launched 16:33:58.441384 run osmo-hlr_10.42.42.2(pid=22935): Launched 16:33:58.553612 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:59.057918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22937): Launched 16:33:59.351748 run osmo-stp_10.42.42.5(pid=22938): Launched 16:33:59.463193 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:33:59.969616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22940): Launched 16:34:00.081967 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:34:00.328826 run patchelf(pid=22941): Launched 16:34:00.492475 run osmo-stp_10.42.42.5(pid=22938): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22938)] 16:34:00.616761 run osmo-stp_10.42.42.5(pid=22938): stdout: | (launched: 2022-12-09_16:33:59.297306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:00.743068 run osmo-stp_10.42.42.5(pid=22938): stderr: | [0;m[38;5;43m20221209163359468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163359468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163359468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163359469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163359469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163359469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163359469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:00.877568 run osmo-stp_10.42.42.5(pid=22938): stdout: | (launched: 2022-12-09_16:33:59.297306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:01.026058 run osmo-stp_10.42.42.5(pid=22938): stderr: | [0;m[38;5;43m20221209163359468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163359468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163359468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163359469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163359469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163359469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163359469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:01.185949 run patchelf(pid=22941): Terminating (SIGINT) 16:34:01.369988 run patchelf(pid=22941): Terminated: ok {rc=0} 16:34:01.493099 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22938): Process ended prematurely: osmo-stp_10.42.42.5(pid=22938) [trial-2361↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22938)] [trial-2361↪gprs:trx-lms-limenet-micro↪ping.py:22] 16:34:01.502319 tst ping.py:22: Test FAILED (6.3 sec) 16:34:01.528849 run osmo-hlr_10.42.42.2(pid=22935): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22935)] 16:34:01.576661 run osmo-hlr_10.42.42.2(pid=22935): stdout: | (launched: 2022-12-09_16:33:58.387350) 16:34:01.626289 run osmo-hlr_10.42.42.2(pid=22935): stderr: | [0;m[1;31m20221209163358561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163358561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163358561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163358561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163358561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163358562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163358578 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163358588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163358588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163358588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:01.676027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22934): Terminating (SIGTERM) 16:34:01.715620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22937): Terminating (SIGTERM) 16:34:01.755121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22940): Terminating (SIGTERM) 16:34:01.794834 --- ParallelTerminationStrategy: PID 22934 died... 16:34:01.813684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22934): Terminated: ok {rc=0} 16:34:01.858482 --- ParallelTerminationStrategy: PID 22937 died... 16:34:01.877202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22937): Terminated: ok {rc=0} 16:34:01.922181 --- ParallelTerminationStrategy: PID 22940 died... 16:34:01.941215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22940): Terminated: ok {rc=0} 16:34:02.026295 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 16:34:03.111997 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:34:03.123837 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:34:03.172667 tst ping_idle_ping.py: using LAC 22317 16:34:03.287811 tst ping_idle_ping.py: using RAC 132 16:34:03.402276 tst ping_idle_ping.py: using CellId 22317 16:34:03.520831 tst ping_idle_ping.py: using BVCI 22318 16:34:03.628764 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:34:03.639650 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:34:03.650391 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:34:03.661150 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:34:03.671720 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:34:03.682424 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:34:03.693095 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 16:34:03.703752 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 16:34:03.817872 tst ping_idle_ping.py:24: start network... 16:34:04.018932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:04.478893 run create_hlr_db(pid=22942): Launched 16:34:04.599659 bus /gobi_6: Setting Powered False 16:34:05.659732 run create_hlr_db(pid=22942): Terminated: ok {rc=0} 16:34:06.094103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22944): Launched 16:34:06.411009 run osmo-hlr_10.42.42.2(pid=22945): Launched 16:34:06.533280 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:07.081552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22947): Launched 16:34:07.397041 run osmo-stp_10.42.42.5(pid=22948): Launched 16:34:07.512190 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:34:08.024320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22950): Launched 16:34:08.137635 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:34:08.387763 run patchelf(pid=22951): Launched 16:34:08.552817 run osmo-stp_10.42.42.5(pid=22948): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22948)] 16:34:08.677560 run osmo-stp_10.42.42.5(pid=22948): stdout: | (launched: 2022-12-09_16:34:07.339372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:08.804869 run osmo-stp_10.42.42.5(pid=22948): stderr: | [0;m[38;5;43m20221209163407510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163407511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163407511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163407511 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163407512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163407512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163407512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:08.932324 run osmo-stp_10.42.42.5(pid=22948): stdout: | (launched: 2022-12-09_16:34:07.339372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:09.053421 run osmo-stp_10.42.42.5(pid=22948): stderr: | [0;m[38;5;43m20221209163407510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163407511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163407511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163407511 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163407512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163407512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163407512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:09.196739 run patchelf(pid=22951): Terminating (SIGINT) 16:34:09.361839 run patchelf(pid=22951): Terminated: ok {rc=0} 16:34:09.481191 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22948): Process ended prematurely: osmo-stp_10.42.42.5(pid=22948) [trial-2361↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22948)] [trial-2361↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 16:34:09.490041 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 16:34:09.516349 run osmo-hlr_10.42.42.2(pid=22945): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22945)] 16:34:09.563689 run osmo-hlr_10.42.42.2(pid=22945): stdout: | (launched: 2022-12-09_16:34:06.353157) 16:34:09.612573 run osmo-hlr_10.42.42.2(pid=22945): stderr: | [0;m[1;31m20221209163406551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163406551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163406551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163406551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163406551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163406551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163406562 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163406570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163406571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163406571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:09.661697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22944): Terminating (SIGTERM) 16:34:09.700916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22947): Terminating (SIGTERM) 16:34:09.740076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22950): Terminating (SIGTERM) 16:34:09.779378 --- ParallelTerminationStrategy: PID 22944 died... 16:34:09.798236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22944): Terminated: ok {rc=0} 16:34:09.841549 --- ParallelTerminationStrategy: PID 22947 died... 16:34:09.859796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22947): Terminated: ok {rc=0} 16:34:09.903592 --- ParallelTerminationStrategy: PID 22950 died... 16:34:09.922058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22950): Terminated: ok {rc=0} 16:34:10.005362 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 16:34:11.302499 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:34:11.308832 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:34:11.337982 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:34:11.376254 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:34:11.462998 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:34:11.491680 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:34:11.529642 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:34:12.130759 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:34:12.183377 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:12.195021 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:34:12.242721 tst cs_paging_gprs_active.py: using LAC 22318 16:34:12.369742 tst cs_paging_gprs_active.py: using RAC 133 16:34:12.494782 tst cs_paging_gprs_active.py: using CellId 22318 16:34:12.620458 tst cs_paging_gprs_active.py: using BVCI 22319 16:34:12.738442 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:12.750143 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:12.761455 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:12.773653 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:12.785317 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:12.796885 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:12.808812 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:12.820790 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:12.832725 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:34:12.952005 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:34:13.071291 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:34:13.288657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:34:13.612379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22955): Launched 16:34:13.894067 run iperf3-srv_10.42.42.10(pid=22956): Launched 16:34:14.015455 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:34:14.232738 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:34:14.556834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22957): Launched 16:34:14.837628 run iperf3-srv_10.42.42.10(pid=22958): Launched 16:34:14.958381 tst cs_paging_gprs_active.py:38: start network... 16:34:15.174980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:15.674072 run create_hlr_db(pid=22959): Launched 16:34:15.797450 bus /gobi_6: Setting Powered False 16:34:16.860137 run create_hlr_db(pid=22959): Terminated: ok {rc=0} 16:34:17.352378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22961): Launched 16:34:17.675424 run osmo-hlr_10.42.42.2(pid=22962): Launched 16:34:17.798963 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:18.358094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22964): Launched 16:34:18.681644 run osmo-stp_10.42.42.5(pid=22965): Launched 16:34:18.804762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:34:19.361701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22967): Launched 16:34:19.485120 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:34:19.756697 run patchelf(pid=22968): Launched 16:34:19.936514 run osmo-stp_10.42.42.5(pid=22965): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22965)] 16:34:20.073354 run osmo-stp_10.42.42.5(pid=22965): stdout: | (launched: 2022-12-09_16:34:18.622572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:20.211575 run osmo-stp_10.42.42.5(pid=22965): stderr: | [0;m[38;5;43m20221209163418814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163418814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163418814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163418815 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163418815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163418815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163418815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:20.350128 run osmo-stp_10.42.42.5(pid=22965): stdout: | (launched: 2022-12-09_16:34:18.622572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:20.482415 run osmo-stp_10.42.42.5(pid=22965): stderr: | [0;m[38;5;43m20221209163418814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163418814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163418814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163418815 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163418815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163418815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163418815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:20.639156 run patchelf(pid=22968): Terminating (SIGINT) 16:34:20.820310 run patchelf(pid=22968): Terminated: ok {rc=0} 16:34:20.952131 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22965): Process ended prematurely: osmo-stp_10.42.42.5(pid=22965) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22965)] [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:34:20.962391 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 16:34:20.991124 run osmo-hlr_10.42.42.2(pid=22962): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22962)] 16:34:21.041340 run osmo-hlr_10.42.42.2(pid=22962): stdout: | (launched: 2022-12-09_16:34:17.616549) 16:34:21.093356 run osmo-hlr_10.42.42.2(pid=22962): stderr: | [0;m[1;31m20221209163417817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163417817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163417817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163417817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163417817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163417817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163417830 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163417838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163417838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163417838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:21.145761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22955): Terminating (SIGTERM) 16:34:21.187780 run iperf3-srv_10.42.42.10(pid=22956): Terminating (SIGTERM) 16:34:21.229632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22957): Terminating (SIGTERM) 16:34:21.271481 run iperf3-srv_10.42.42.10(pid=22958): Terminating (SIGTERM) 16:34:21.313317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22961): Terminating (SIGTERM) 16:34:21.355321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22964): Terminating (SIGTERM) 16:34:21.397086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22967): Terminating (SIGTERM) 16:34:21.439276 --- ParallelTerminationStrategy: PID 22955 died... 16:34:21.459193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22955): Terminated: ok {rc=0} 16:34:21.505725 --- ParallelTerminationStrategy: PID 22956 died... 16:34:21.525206 run iperf3-srv_10.42.42.10(pid=22956): Terminated {rc=256} 16:34:21.571292 --- ParallelTerminationStrategy: PID 22957 died... 16:34:21.590850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22957): Terminated: ok {rc=0} 16:34:21.637192 --- ParallelTerminationStrategy: PID 22958 died... 16:34:21.656316 run iperf3-srv_10.42.42.10(pid=22958): Terminated {rc=256} 16:34:21.702568 --- ParallelTerminationStrategy: PID 22961 died... 16:34:21.722121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22961): Terminated: ok {rc=0} 16:34:21.768461 --- ParallelTerminationStrategy: PID 22964 died... 16:34:21.788018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22964): Terminated: ok {rc=0} 16:34:21.835181 --- ParallelTerminationStrategy: PID 22967 died... 16:34:21.854803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22967): Terminated: ok {rc=0} 16:34:21.942877 bus /gobi_0: Setting Powered False 16:34:23.041764 bus /gobi_0: Setting Powered False 16:34:24.159828 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:34:25.307513 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:25.319954 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:34:25.368088 tst iperf3.py: using LAC 22319 16:34:25.494383 tst iperf3.py: using RAC 134 16:34:25.618424 tst iperf3.py: using CellId 22319 16:34:25.746075 tst iperf3.py: using BVCI 22320 16:34:25.862943 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:25.874605 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:25.886407 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:25.898059 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:25.909656 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:25.921193 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:25.932748 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:25.944223 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:25.956086 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:34:26.073551 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:34:26.276111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:34:26.576859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22969): Launched 16:34:26.842537 run iperf3-srv_10.42.42.10(pid=22970): Launched 16:34:26.957312 tst iperf3.py:8: start network... 16:34:27.158449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:27.620813 run create_hlr_db(pid=22971): Launched 16:34:27.745915 bus /gobi_6: Setting Powered False 16:34:28.805605 run create_hlr_db(pid=22971): Terminated: ok {rc=0} 16:34:29.245570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22973): Launched 16:34:29.567388 run osmo-hlr_10.42.42.2(pid=22974): Launched 16:34:29.690892 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:30.246531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22976): Launched 16:34:30.568139 run osmo-stp_10.42.42.5(pid=22977): Launched 16:34:30.690818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:34:31.283988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22979): Launched 16:34:31.419686 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:34:31.705779 run patchelf(pid=22980): Launched 16:34:31.901568 run osmo-stp_10.42.42.5(pid=22977): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22977)] 16:34:32.041942 run osmo-stp_10.42.42.5(pid=22977): stdout: | (launched: 2022-12-09_16:34:30.509390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:32.183645 run osmo-stp_10.42.42.5(pid=22977): stderr: | [0;m[38;5;43m20221209163430704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163430704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163430704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163430705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163430705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163430705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163430705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:32.322076 run osmo-stp_10.42.42.5(pid=22977): stdout: | (launched: 2022-12-09_16:34:30.509390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:32.453716 run osmo-stp_10.42.42.5(pid=22977): stderr: | [0;m[38;5;43m20221209163430704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163430704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163430704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163430705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163430705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163430705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163430705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:32.609847 run patchelf(pid=22980): Terminating (SIGINT) 16:34:32.791307 run patchelf(pid=22980): Terminated: ok {rc=0} 16:34:32.921863 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22977): Process ended prematurely: osmo-stp_10.42.42.5(pid=22977) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22977)] [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 16:34:32.932155 tst iperf3.py:8: Test FAILED (7.7 sec) 16:34:32.961282 run osmo-hlr_10.42.42.2(pid=22974): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22974)] 16:34:33.011009 run osmo-hlr_10.42.42.2(pid=22974): stdout: | (launched: 2022-12-09_16:34:29.508582) 16:34:33.062378 run osmo-hlr_10.42.42.2(pid=22974): stderr: | [0;m[1;31m20221209163429708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163429708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163429708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163429708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163429708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163429708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163429719 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163429728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163429728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163429728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:33.114215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22969): Terminating (SIGTERM) 16:34:33.155713 run iperf3-srv_10.42.42.10(pid=22970): Terminating (SIGTERM) 16:34:33.197574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22973): Terminating (SIGTERM) 16:34:33.239183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22976): Terminating (SIGTERM) 16:34:33.280848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22979): Terminating (SIGTERM) 16:34:33.323289 --- ParallelTerminationStrategy: PID 22969 died... 16:34:33.343175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22969): Terminated: ok {rc=0} 16:34:33.389577 --- ParallelTerminationStrategy: PID 22970 died... 16:34:33.408834 run iperf3-srv_10.42.42.10(pid=22970): Terminated {rc=256} 16:34:33.454962 --- ParallelTerminationStrategy: PID 22973 died... 16:34:33.474447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22973): Terminated: ok {rc=0} 16:34:33.520210 --- ParallelTerminationStrategy: PID 22976 died... 16:34:33.539525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22976): Terminated: ok {rc=0} 16:34:33.585672 --- ParallelTerminationStrategy: PID 22979 died... 16:34:33.605163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22979): Terminated: ok {rc=0} 16:34:33.693256 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:34:34.841345 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:34.853938 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:34:34.901785 tst iperf3m4.py: using LAC 22320 16:34:35.026559 tst iperf3m4.py: using RAC 135 16:34:35.151451 tst iperf3m4.py: using CellId 22320 16:34:35.276562 tst iperf3m4.py: using BVCI 22321 16:34:35.392484 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:35.404120 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:35.415403 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:35.426994 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:35.438630 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:35.450215 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:35.461940 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:35.473452 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:35.485304 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:34:35.612822 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:34:35.733380 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:34:35.852297 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:34:35.970690 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:34:36.173885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:34:36.475549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22981): Launched 16:34:36.738318 run iperf3-srv_10.42.42.10(pid=22982): Launched 16:34:36.851357 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:34:37.054114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:34:37.356183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22983): Launched 16:34:37.619049 run iperf3-srv_10.42.42.10(pid=22984): Launched 16:34:37.731988 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:34:37.934425 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:34:38.241813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22985): Launched 16:34:38.525568 run iperf3-srv_10.42.42.10(pid=22986): Launched 16:34:38.646331 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:34:38.864742 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:34:39.188816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22987): Launched 16:34:39.470182 run iperf3-srv_10.42.42.10(pid=22988): Launched 16:34:39.592803 tst iperf3m4.py:8: start network... 16:34:39.811052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:40.311480 run create_hlr_db(pid=22989): Launched 16:34:40.435230 bus /gobi_6: Setting Powered False 16:34:41.499012 run create_hlr_db(pid=22989): Terminated: ok {rc=0} 16:34:41.931055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22991): Launched 16:34:42.233104 run osmo-hlr_10.42.42.2(pid=22992): Launched 16:34:42.346910 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:42.879848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22994): Launched 16:34:43.181060 run osmo-stp_10.42.42.5(pid=22995): Launched 16:34:43.295909 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:34:43.814033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22997): Launched 16:34:43.929349 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:34:44.182702 run patchelf(pid=22998): Launched 16:34:44.351435 run osmo-stp_10.42.42.5(pid=22995): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22995)] 16:34:44.478380 run osmo-stp_10.42.42.5(pid=22995): stdout: | (launched: 2022-12-09_16:34:43.125413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:44.607442 run osmo-stp_10.42.42.5(pid=22995): stderr: | [0;m[38;5;43m20221209163443292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163443292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163443292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163443292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163443293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163443293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163443293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:44.736693 run osmo-stp_10.42.42.5(pid=22995): stdout: | (launched: 2022-12-09_16:34:43.125413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:44.860346 run osmo-stp_10.42.42.5(pid=22995): stderr: | [0;m[38;5;43m20221209163443292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163443292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163443292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163443292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163443293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163443293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163443293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:45.006291 run patchelf(pid=22998): Terminating (SIGINT) 16:34:45.175047 run patchelf(pid=22998): Terminated: ok {rc=0} 16:34:45.297073 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22995): Process ended prematurely: osmo-stp_10.42.42.5(pid=22995) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22995)] [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 16:34:45.306562 tst iperf3m4.py:8: Test FAILED (10.5 sec) 16:34:45.333543 run osmo-hlr_10.42.42.2(pid=22992): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22992)] 16:34:45.380808 run osmo-hlr_10.42.42.2(pid=22992): stdout: | (launched: 2022-12-09_16:34:42.177551) 16:34:45.429717 run osmo-hlr_10.42.42.2(pid=22992): stderr: | [0;m[1;31m20221209163442354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163442354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163442354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163442354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163442354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163442354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163442366 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163442375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163442376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163442376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:45.478810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22981): Terminating (SIGTERM) 16:34:45.518045 run iperf3-srv_10.42.42.10(pid=22982): Terminating (SIGTERM) 16:34:45.557301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22983): Terminating (SIGTERM) 16:34:45.596411 run iperf3-srv_10.42.42.10(pid=22984): Terminating (SIGTERM) 16:34:45.635524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22985): Terminating (SIGTERM) 16:34:45.674721 run iperf3-srv_10.42.42.10(pid=22986): Terminating (SIGTERM) 16:34:45.713701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22987): Terminating (SIGTERM) 16:34:45.752874 run iperf3-srv_10.42.42.10(pid=22988): Terminating (SIGTERM) 16:34:45.791931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22991): Terminating (SIGTERM) 16:34:45.831149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22994): Terminating (SIGTERM) 16:34:45.880279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22997): Terminating (SIGTERM) 16:34:45.927124 --- ParallelTerminationStrategy: PID 22981 died... 16:34:45.947805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22981): Terminated: ok {rc=0} 16:34:45.998464 --- ParallelTerminationStrategy: PID 22982 died... 16:34:46.020673 run iperf3-srv_10.42.42.10(pid=22982): Terminated {rc=256} 16:34:46.069527 --- ParallelTerminationStrategy: PID 22983 died... 16:34:46.090104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22983): Terminated: ok {rc=0} 16:34:46.139799 --- ParallelTerminationStrategy: PID 22984 died... 16:34:46.160851 run iperf3-srv_10.42.42.10(pid=22984): Terminated {rc=256} 16:34:46.211286 --- ParallelTerminationStrategy: PID 22985 died... 16:34:46.231619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22985): Terminated: ok {rc=0} 16:34:46.281097 --- ParallelTerminationStrategy: PID 22986 died... 16:34:46.301584 run iperf3-srv_10.42.42.10(pid=22986): Terminated {rc=256} 16:34:46.352391 --- ParallelTerminationStrategy: PID 22987 died... 16:34:46.372797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22987): Terminated: ok {rc=0} 16:34:46.423788 --- ParallelTerminationStrategy: PID 22988 died... 16:34:46.444408 run iperf3-srv_10.42.42.10(pid=22988): Terminated {rc=256} 16:34:46.494084 --- ParallelTerminationStrategy: PID 22991 died... 16:34:46.514629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22991): Terminated: ok {rc=0} 16:34:46.564760 --- ParallelTerminationStrategy: PID 22994 died... 16:34:46.585508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22994): Terminated: ok {rc=0} 16:34:46.635611 --- ParallelTerminationStrategy: PID 22997 died... 16:34:46.656389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22997): Terminated: ok {rc=0} 16:34:46.754333 bus /gobi_4: Setting Powered False 16:34:47.867678 bus /gobi_4: Setting Powered False 16:34:48.984315 bus /gobi_1: Setting Powered False 16:34:50.078024 bus /gobi_1: Setting Powered False 16:34:51.192210 bus /gobi_0: Setting Powered False 16:34:52.292465 bus /gobi_0: Setting Powered False 16:34:53.410456 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 16:34:54.512681 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:54.524397 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:34:54.571342 tst ping.py: using LAC 22321 16:34:54.695961 tst ping.py: using RAC 136 16:34:54.818631 tst ping.py: using CellId 22321 16:34:54.942247 tst ping.py: using BVCI 22322 16:34:55.056850 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:55.068479 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:55.079880 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:55.091515 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:55.102915 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:55.114444 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:55.126140 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:34:55.137793 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:34:55.254416 tst ping.py:19: start network... 16:34:55.465940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:55.955183 run create_hlr_db(pid=22999): Launched 16:34:56.075564 bus /gobi_6: Setting Powered False 16:34:57.138690 run create_hlr_db(pid=22999): Terminated: ok {rc=0} 16:34:57.579173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23001): Launched 16:34:57.897051 run osmo-hlr_10.42.42.2(pid=23002): Launched 16:34:58.018807 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:58.565839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23004): Launched 16:34:58.882825 run osmo-stp_10.42.42.5(pid=23005): Launched 16:34:59.004733 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:34:59.552753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23007): Launched 16:34:59.674417 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:34:59.943325 run patchelf(pid=23008): Launched 16:35:00.120213 run osmo-stp_10.42.42.5(pid=23005): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23005)] 16:35:00.254098 run osmo-stp_10.42.42.5(pid=23005): stdout: | (launched: 2022-12-09_16:34:58.824458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:00.390406 run osmo-stp_10.42.42.5(pid=23005): stderr: | [0;m[38;5;43m20221209163459016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163459017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163459017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163459017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163459018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163459018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163459018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:00.526675 run osmo-stp_10.42.42.5(pid=23005): stdout: | (launched: 2022-12-09_16:34:58.824458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:00.656918 run osmo-stp_10.42.42.5(pid=23005): stderr: | [0;m[38;5;43m20221209163459016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163459017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163459017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163459017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163459018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163459018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163459018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:00.810964 run patchelf(pid=23008): Terminating (SIGINT) 16:35:00.999130 run patchelf(pid=23008): Terminated: ok {rc=0} 16:35:01.131033 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23005): Process ended prematurely: osmo-stp_10.42.42.5(pid=23005) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23005)] [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 16:35:01.141733 tst ping.py:22: Test FAILED (6.6 sec) 16:35:01.172172 run osmo-hlr_10.42.42.2(pid=23002): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23002)] 16:35:01.224244 run osmo-hlr_10.42.42.2(pid=23002): stdout: | (launched: 2022-12-09_16:34:57.839205) 16:35:01.278191 run osmo-hlr_10.42.42.2(pid=23002): stderr: | [0;m[1;31m20221209163458036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163458036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163458036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163458036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163458036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163458036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163458075 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163458084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163458084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163458084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:01.332782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23001): Terminating (SIGTERM) 16:35:01.377383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23004): Terminating (SIGTERM) 16:35:01.421530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23007): Terminating (SIGTERM) 16:35:01.466868 --- ParallelTerminationStrategy: PID 23001 died... 16:35:01.487473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23001): Terminated: ok {rc=0} 16:35:01.536446 --- ParallelTerminationStrategy: PID 23004 died... 16:35:01.557082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23004): Terminated: ok {rc=0} 16:35:01.606066 --- ParallelTerminationStrategy: PID 23007 died... 16:35:01.626738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23007): Terminated: ok {rc=0} 16:35:01.716620 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:35:02.805734 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:35:02.818599 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:35:02.869405 tst ping_idle_ping.py: using LAC 22322 16:35:02.996463 tst ping_idle_ping.py: using RAC 137 16:35:03.121752 tst ping_idle_ping.py: using CellId 22322 16:35:03.239618 tst ping_idle_ping.py: using BVCI 22323 16:35:03.356357 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:35:03.368216 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:35:03.379909 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:35:03.391469 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:35:03.403139 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:35:03.415936 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:35:03.427610 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:35:03.439227 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:35:03.558146 tst ping_idle_ping.py:24: start network... 16:35:03.772881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:04.266256 run create_hlr_db(pid=23012): Launched 16:35:04.386841 bus /gobi_6: Setting Powered False 16:35:05.450039 run create_hlr_db(pid=23012): Terminated: ok {rc=0} 16:35:05.876388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23014): Launched 16:35:06.173382 run osmo-hlr_10.42.42.2(pid=23015): Launched 16:35:06.285810 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:06.806048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23017): Launched 16:35:07.102765 run osmo-stp_10.42.42.5(pid=23018): Launched 16:35:07.215004 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:35:07.724727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23020): Launched 16:35:07.838530 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:35:08.088310 run patchelf(pid=23021): Launched 16:35:08.254844 run osmo-stp_10.42.42.5(pid=23018): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23018)] 16:35:08.379502 run osmo-stp_10.42.42.5(pid=23018): stdout: | (launched: 2022-12-09_16:35:07.047918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:08.506162 run osmo-stp_10.42.42.5(pid=23018): stderr: | [0;m[38;5;43m20221209163507218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163507218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163507218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163507218 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163507221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163507221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163507221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:08.632505 run osmo-stp_10.42.42.5(pid=23018): stdout: | (launched: 2022-12-09_16:35:07.047918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:08.753752 run osmo-stp_10.42.42.5(pid=23018): stderr: | [0;m[38;5;43m20221209163507218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163507218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163507218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163507218 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163507221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163507221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163507221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:08.897405 run patchelf(pid=23021): Terminating (SIGINT) 16:35:09.064241 run patchelf(pid=23021): Terminated: ok {rc=0} 16:35:09.183336 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23018): Process ended prematurely: osmo-stp_10.42.42.5(pid=23018) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23018)] [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 16:35:09.192230 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 16:35:09.218691 run osmo-hlr_10.42.42.2(pid=23015): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23015)] 16:35:09.265969 run osmo-hlr_10.42.42.2(pid=23015): stdout: | (launched: 2022-12-09_16:35:06.118806) 16:35:09.315319 run osmo-hlr_10.42.42.2(pid=23015): stderr: | [0;m[1;31m20221209163506296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163506296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163506296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163506296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163506296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163506296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163506309 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163506318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163506318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163506318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:09.365136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23014): Terminating (SIGTERM) 16:35:09.404384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23017): Terminating (SIGTERM) 16:35:09.443736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23020): Terminating (SIGTERM) 16:35:09.483323 --- ParallelTerminationStrategy: PID 23014 died... 16:35:09.502117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23014): Terminated: ok {rc=0} 16:35:09.545415 --- ParallelTerminationStrategy: PID 23017 died... 16:35:09.563628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23017): Terminated: ok {rc=0} 16:35:09.606608 --- ParallelTerminationStrategy: PID 23020 died... 16:35:09.624825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23020): Terminated: ok {rc=0} 16:35:09.709245 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:35:11.008698 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:35:11.015462 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:35:11.045166 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:35:11.083282 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:35:11.169248 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:35:11.197930 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:35:11.235754 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:35:11.839355 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:35:11.893687 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:11.905389 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:35:11.974613 tst cs_paging_gprs_active.py: using LAC 22323 16:35:12.103457 tst cs_paging_gprs_active.py: using RAC 138 16:35:12.229176 tst cs_paging_gprs_active.py: using CellId 22323 16:35:12.357306 tst cs_paging_gprs_active.py: using BVCI 22324 16:35:12.476176 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:12.487824 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:12.499259 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:12.511045 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:12.522797 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:12.534423 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:12.546288 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:12.557983 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:12.569962 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:35:12.693226 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:35:12.809377 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:35:13.013111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:13.316265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23026): Launched 16:35:13.579773 run iperf3-srv_10.42.42.10(pid=23027): Launched 16:35:13.694096 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:35:13.896941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:14.199460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23028): Launched 16:35:14.463410 run iperf3-srv_10.42.42.10(pid=23029): Launched 16:35:14.576218 tst cs_paging_gprs_active.py:38: start network... 16:35:14.778267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:15.245728 run create_hlr_db(pid=23030): Launched 16:35:15.369974 bus /gobi_6: Setting Powered False 16:35:16.444153 run create_hlr_db(pid=23030): Terminated: ok {rc=0} 16:35:16.925972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23032): Launched 16:35:17.270731 run osmo-hlr_10.42.42.2(pid=23033): Launched 16:35:17.398245 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:17.957621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23035): Launched 16:35:18.281527 run osmo-stp_10.42.42.5(pid=23036): Launched 16:35:18.406814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:35:18.965507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23038): Launched 16:35:19.091837 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:35:19.366319 run patchelf(pid=23039): Launched 16:35:19.548737 run osmo-stp_10.42.42.5(pid=23036): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23036)] 16:35:19.686659 run osmo-stp_10.42.42.5(pid=23036): stdout: | (launched: 2022-12-09_16:35:18.222864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:19.826007 run osmo-stp_10.42.42.5(pid=23036): stderr: | [0;m[38;5;43m20221209163518416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163518416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163518416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163518417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163518417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163518417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163518417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:19.965408 run osmo-stp_10.42.42.5(pid=23036): stdout: | (launched: 2022-12-09_16:35:18.222864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:20.098338 run osmo-stp_10.42.42.5(pid=23036): stderr: | [0;m[38;5;43m20221209163518416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163518416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163518416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163518417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163518417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163518417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163518417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:20.256098 run patchelf(pid=23039): Terminating (SIGINT) 16:35:20.437676 run patchelf(pid=23039): Terminated: ok {rc=0} 16:35:20.568902 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23036): Process ended prematurely: osmo-stp_10.42.42.5(pid=23036) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23036)] [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:35:20.579168 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:35:20.607981 run osmo-hlr_10.42.42.2(pid=23033): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23033)] 16:35:20.657863 run osmo-hlr_10.42.42.2(pid=23033): stdout: | (launched: 2022-12-09_16:35:17.211025) 16:35:20.709360 run osmo-hlr_10.42.42.2(pid=23033): stderr: | [0;m[1;31m20221209163517408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163517408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163517408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163517408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163517408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163517408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163517420 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163517428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163517429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163517429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:20.761460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23026): Terminating (SIGTERM) 16:35:20.803055 run iperf3-srv_10.42.42.10(pid=23027): Terminating (SIGTERM) 16:35:20.844561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23028): Terminating (SIGTERM) 16:35:20.886262 run iperf3-srv_10.42.42.10(pid=23029): Terminating (SIGTERM) 16:35:20.928184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23032): Terminating (SIGTERM) 16:35:20.970044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23035): Terminating (SIGTERM) 16:35:21.011709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23038): Terminating (SIGTERM) 16:35:21.053705 --- ParallelTerminationStrategy: PID 23026 died... 16:35:21.073473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23026): Terminated: ok {rc=0} 16:35:21.119957 --- ParallelTerminationStrategy: PID 23027 died... 16:35:21.139188 run iperf3-srv_10.42.42.10(pid=23027): Terminated {rc=256} 16:35:21.185062 --- ParallelTerminationStrategy: PID 23028 died... 16:35:21.204331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23028): Terminated: ok {rc=0} 16:35:21.250174 --- ParallelTerminationStrategy: PID 23029 died... 16:35:21.269494 run iperf3-srv_10.42.42.10(pid=23029): Terminated {rc=256} 16:35:21.315365 --- ParallelTerminationStrategy: PID 23032 died... 16:35:21.334716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23032): Terminated: ok {rc=0} 16:35:21.381104 --- ParallelTerminationStrategy: PID 23035 died... 16:35:21.400463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23035): Terminated: ok {rc=0} 16:35:21.446453 --- ParallelTerminationStrategy: PID 23038 died... 16:35:21.465780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23038): Terminated: ok {rc=0} 16:35:21.552900 bus /gobi_0: Setting Powered False 16:35:22.652424 bus /gobi_0: Setting Powered False 16:35:23.768924 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:35:24.914228 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:24.926344 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:35:24.994952 tst iperf3.py: using LAC 22324 16:35:25.116729 tst iperf3.py: using RAC 139 16:35:25.234861 tst iperf3.py: using CellId 22324 16:35:25.353034 tst iperf3.py: using BVCI 22325 16:35:25.461079 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:25.472086 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:25.482998 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:25.493926 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:25.504768 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:25.515630 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:25.526734 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:25.537486 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:25.548391 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:35:25.662951 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:35:25.865625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:26.168264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23040): Launched 16:35:26.431481 run iperf3-srv_10.42.42.10(pid=23041): Launched 16:35:26.544705 tst iperf3.py:8: start network... 16:35:26.747391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:27.213358 run create_hlr_db(pid=23042): Launched 16:35:27.336804 bus /gobi_6: Setting Powered False 16:35:28.396803 run create_hlr_db(pid=23042): Terminated: ok {rc=0} 16:35:28.838768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23044): Launched 16:35:29.163912 run osmo-hlr_10.42.42.2(pid=23045): Launched 16:35:29.287731 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:29.848021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23047): Launched 16:35:30.171727 run osmo-stp_10.42.42.5(pid=23048): Launched 16:35:30.295077 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:35:30.858074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23050): Launched 16:35:30.991607 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:35:31.258296 run patchelf(pid=23051): Launched 16:35:31.490912 run osmo-stp_10.42.42.5(pid=23048): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23048)] 16:35:31.627406 run osmo-stp_10.42.42.5(pid=23048): stdout: | (launched: 2022-12-09_16:35:30.113230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:31.762834 run osmo-stp_10.42.42.5(pid=23048): stderr: | [0;m[38;5;43m20221209163530306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163530306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163530306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163530307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163530309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163530309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163530309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:31.899037 run osmo-stp_10.42.42.5(pid=23048): stdout: | (launched: 2022-12-09_16:35:30.113230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:32.028672 run osmo-stp_10.42.42.5(pid=23048): stderr: | [0;m[38;5;43m20221209163530306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163530306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163530306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163530307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163530309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163530309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163530309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:32.177936 run patchelf(pid=23051): Terminating (SIGINT) 16:35:32.350631 run patchelf(pid=23051): Terminated: ok {rc=0} 16:35:32.473730 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23048): Process ended prematurely: osmo-stp_10.42.42.5(pid=23048) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23048)] [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 16:35:32.483175 tst iperf3.py:8: Test FAILED (7.6 sec) 16:35:32.510827 run osmo-hlr_10.42.42.2(pid=23045): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23045)] 16:35:32.558236 run osmo-hlr_10.42.42.2(pid=23045): stdout: | (launched: 2022-12-09_16:35:29.104337) 16:35:32.607502 run osmo-hlr_10.42.42.2(pid=23045): stderr: | [0;m[1;31m20221209163529304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163529304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163529304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163529304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163529304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163529305 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163529316 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163529324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163529325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163529325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:32.657331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23040): Terminating (SIGTERM) 16:35:32.697105 run iperf3-srv_10.42.42.10(pid=23041): Terminating (SIGTERM) 16:35:32.736644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23044): Terminating (SIGTERM) 16:35:32.776650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23047): Terminating (SIGTERM) 16:35:32.816258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23050): Terminating (SIGTERM) 16:35:32.856051 --- ParallelTerminationStrategy: PID 23040 died... 16:35:32.875054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23040): Terminated: ok {rc=0} 16:35:32.919153 --- ParallelTerminationStrategy: PID 23041 died... 16:35:32.937633 run iperf3-srv_10.42.42.10(pid=23041): Terminated {rc=256} 16:35:32.981338 --- ParallelTerminationStrategy: PID 23044 died... 16:35:33.000167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23044): Terminated: ok {rc=0} 16:35:33.043921 --- ParallelTerminationStrategy: PID 23047 died... 16:35:33.062411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23047): Terminated: ok {rc=0} 16:35:33.106042 --- ParallelTerminationStrategy: PID 23050 died... 16:35:33.124440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23050): Terminated: ok {rc=0} 16:35:33.208022 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:35:34.351497 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:34.363276 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:35:34.429151 tst iperf3m4.py: using LAC 22325 16:35:34.546518 tst iperf3m4.py: using RAC 140 16:35:34.668364 tst iperf3m4.py: using CellId 22325 16:35:34.786887 tst iperf3m4.py: using BVCI 22326 16:35:34.896788 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:34.907986 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:34.919049 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:34.930052 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:34.941034 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:34.951881 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:34.962904 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:34.973868 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:34.984856 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:35:35.102376 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:35:35.220744 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:35:35.337177 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:35:35.460079 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:35:35.663234 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:35.966474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23052): Launched 16:35:36.231963 run iperf3-srv_10.42.42.10(pid=23053): Launched 16:35:36.345429 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:35:36.548217 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:36.851696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23054): Launched 16:35:37.115475 run iperf3-srv_10.42.42.10(pid=23055): Launched 16:35:37.229971 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:35:37.432726 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:37.736227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23056): Launched 16:35:38.001578 run iperf3-srv_10.42.42.10(pid=23057): Launched 16:35:38.114408 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:35:38.316031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:35:38.618439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23058): Launched 16:35:38.884052 run iperf3-srv_10.42.42.10(pid=23059): Launched 16:35:38.997303 tst iperf3m4.py:8: start network... 16:35:39.200206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:39.668547 run create_hlr_db(pid=23060): Launched 16:35:39.791856 bus /gobi_6: Setting Powered False 16:35:40.852078 run create_hlr_db(pid=23060): Terminated: ok {rc=0} 16:35:41.274164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23062): Launched 16:35:41.575887 run osmo-hlr_10.42.42.2(pid=23063): Launched 16:35:41.690147 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:42.213533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23065): Launched 16:35:42.538491 run osmo-stp_10.42.42.5(pid=23066): Launched 16:35:42.664814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:35:43.222889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23068): Launched 16:35:43.349370 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:35:43.623702 run patchelf(pid=23069): Launched 16:35:43.805464 run osmo-stp_10.42.42.5(pid=23066): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23066)] 16:35:43.943813 run osmo-stp_10.42.42.5(pid=23066): stdout: | (launched: 2022-12-09_16:35:42.480014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:44.083046 run osmo-stp_10.42.42.5(pid=23066): stderr: | [0;m[38;5;43m20221209163542669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163542669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163542669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163542670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163542670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163542670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163542670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:44.225036 run osmo-stp_10.42.42.5(pid=23066): stdout: | (launched: 2022-12-09_16:35:42.480014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:44.357689 run osmo-stp_10.42.42.5(pid=23066): stderr: | [0;m[38;5;43m20221209163542669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163542669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163542669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163542670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163542670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163542670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163542670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:44.515144 run patchelf(pid=23069): Terminating (SIGINT) 16:35:44.696501 run patchelf(pid=23069): Terminated: ok {rc=0} 16:35:44.827681 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23066): Process ended prematurely: osmo-stp_10.42.42.5(pid=23066) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23066)] [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:35:44.838084 tst iperf3m4.py:8: Test FAILED (10.5 sec) 16:35:44.867527 run osmo-hlr_10.42.42.2(pid=23063): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23063)] 16:35:44.917346 run osmo-hlr_10.42.42.2(pid=23063): stdout: | (launched: 2022-12-09_16:35:41.520177) 16:35:44.969437 run osmo-hlr_10.42.42.2(pid=23063): stderr: | [0;m[1;31m20221209163541694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163541694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163541694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163541694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163541694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163541694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163541706 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163541715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163541715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163541715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:45.021721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23052): Terminating (SIGTERM) 16:35:45.063504 run iperf3-srv_10.42.42.10(pid=23053): Terminating (SIGTERM) 16:35:45.105471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23054): Terminating (SIGTERM) 16:35:45.147313 run iperf3-srv_10.42.42.10(pid=23055): Terminating (SIGTERM) 16:35:45.188809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23056): Terminating (SIGTERM) 16:35:45.231126 run iperf3-srv_10.42.42.10(pid=23057): Terminating (SIGTERM) 16:35:45.273027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23058): Terminating (SIGTERM) 16:35:45.314664 run iperf3-srv_10.42.42.10(pid=23059): Terminating (SIGTERM) 16:35:45.356845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23062): Terminating (SIGTERM) 16:35:45.398691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23065): Terminating (SIGTERM) 16:35:45.440247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23068): Terminating (SIGTERM) 16:35:45.482206 --- ParallelTerminationStrategy: PID 23052 died... 16:35:45.502026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23052): Terminated: ok {rc=0} 16:35:45.548175 --- ParallelTerminationStrategy: PID 23053 died... 16:35:45.567683 run iperf3-srv_10.42.42.10(pid=23053): Terminated {rc=256} 16:35:45.613528 --- ParallelTerminationStrategy: PID 23054 died... 16:35:45.632901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23054): Terminated: ok {rc=0} 16:35:45.679147 --- ParallelTerminationStrategy: PID 23055 died... 16:35:45.698490 run iperf3-srv_10.42.42.10(pid=23055): Terminated {rc=256} 16:35:45.744567 --- ParallelTerminationStrategy: PID 23056 died... 16:35:45.764028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23056): Terminated: ok {rc=0} 16:35:45.810106 --- ParallelTerminationStrategy: PID 23057 died... 16:35:45.829582 run iperf3-srv_10.42.42.10(pid=23057): Terminated {rc=256} 16:35:45.899113 --- ParallelTerminationStrategy: PID 23058 died... 16:35:45.919213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23058): Terminated: ok {rc=0} 16:35:45.966108 --- ParallelTerminationStrategy: PID 23059 died... 16:35:45.985688 run iperf3-srv_10.42.42.10(pid=23059): Terminated {rc=256} 16:35:46.034003 --- ParallelTerminationStrategy: PID 23062 died... 16:35:46.053521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23062): Terminated: ok {rc=0} 16:35:46.100614 --- ParallelTerminationStrategy: PID 23065 died... 16:35:46.120222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23065): Terminated: ok {rc=0} 16:35:46.167825 --- ParallelTerminationStrategy: PID 23068 died... 16:35:46.187463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23068): Terminated: ok {rc=0} 16:35:46.276599 bus /gobi_4: Setting Powered False 16:35:47.373301 bus /gobi_4: Setting Powered False 16:35:48.489602 bus /gobi_1: Setting Powered False 16:35:49.587767 bus /gobi_1: Setting Powered False 16:35:50.702874 bus /gobi_0: Setting Powered False 16:35:51.801510 bus /gobi_0: Setting Powered False 16:35:52.917126 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:35:54.020387 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:54.032416 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:35:54.098260 tst ping.py: using LAC 22326 16:35:54.215761 tst ping.py: using RAC 141 16:35:54.330769 tst ping.py: using CellId 22326 16:35:54.447080 tst ping.py: using BVCI 22327 16:35:54.553044 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:54.564236 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:54.575115 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:54.586112 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:54.596850 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:54.608103 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:54.619077 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:35:54.630147 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:35:54.745801 tst ping.py:19: start network... 16:35:54.944568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:55.401293 run create_hlr_db(pid=23070): Launched 16:35:55.522235 bus /gobi_6: Setting Powered False 16:35:56.581882 run create_hlr_db(pid=23070): Terminated: ok {rc=0} 16:35:56.995770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23072): Launched 16:35:57.291177 run osmo-hlr_10.42.42.2(pid=23073): Launched 16:35:57.404440 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:57.931452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23075): Launched 16:35:58.226548 run osmo-stp_10.42.42.5(pid=23076): Launched 16:35:58.338524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:35:58.847554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23078): Launched 16:35:58.961090 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:35:59.212676 run patchelf(pid=23079): Launched 16:35:59.379272 run osmo-stp_10.42.42.5(pid=23076): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23076)] 16:35:59.504805 run osmo-stp_10.42.42.5(pid=23076): stdout: | (launched: 2022-12-09_16:35:58.172191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:59.631736 run osmo-stp_10.42.42.5(pid=23076): stderr: | [0;m[38;5;43m20221209163558343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163558343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163558343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163558344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163558344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163558344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163558344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:59.758903 run osmo-stp_10.42.42.5(pid=23076): stdout: | (launched: 2022-12-09_16:35:58.172191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:59.880182 run osmo-stp_10.42.42.5(pid=23076): stderr: | [0;m[38;5;43m20221209163558343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163558343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163558343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163558344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163558344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163558344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163558344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:00.023780 run patchelf(pid=23079): Terminating (SIGINT) 16:36:00.189729 run patchelf(pid=23079): Terminated: ok {rc=0} 16:36:00.308816 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23076): Process ended prematurely: osmo-stp_10.42.42.5(pid=23076) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23076)] [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 16:36:00.317743 tst ping.py:22: Test FAILED (6.3 sec) 16:36:00.344085 run osmo-hlr_10.42.42.2(pid=23073): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23073)] 16:36:00.391115 run osmo-hlr_10.42.42.2(pid=23073): stdout: | (launched: 2022-12-09_16:35:57.236941) 16:36:00.439699 run osmo-hlr_10.42.42.2(pid=23073): stderr: | [0;m[1;31m20221209163557417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163557417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163557417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163557417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163557417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163557417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163557430 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163557438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163557438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163557438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:00.489033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23072): Terminating (SIGTERM) 16:36:00.528116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23075): Terminating (SIGTERM) 16:36:00.567113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23078): Terminating (SIGTERM) 16:36:00.606461 --- ParallelTerminationStrategy: PID 23072 died... 16:36:00.625416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23072): Terminated: ok {rc=0} 16:36:00.669124 --- ParallelTerminationStrategy: PID 23075 died... 16:36:00.687607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23075): Terminated: ok {rc=0} 16:36:00.730944 --- ParallelTerminationStrategy: PID 23078 died... 16:36:00.749486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23078): Terminated: ok {rc=0} 16:36:00.834814 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:36:01.940087 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:36:01.953899 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:36:02.029663 tst ping_idle_ping.py: using LAC 22327 16:36:02.173537 tst ping_idle_ping.py: using RAC 142 16:36:02.296752 tst ping_idle_ping.py: using CellId 22327 16:36:02.416730 tst ping_idle_ping.py: using BVCI 22328 16:36:02.535425 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:36:02.547125 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:36:02.558711 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:36:02.571066 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:36:02.583402 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:36:02.595858 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:36:02.608791 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:36:02.622520 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:36:02.739759 tst ping_idle_ping.py:24: start network... 16:36:02.939845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:03.401222 run create_hlr_db(pid=23080): Launched 16:36:03.524145 bus /gobi_6: Setting Powered False 16:36:04.583945 run create_hlr_db(pid=23080): Terminated: ok {rc=0} 16:36:05.020036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23082): Launched 16:36:05.341078 run osmo-hlr_10.42.42.2(pid=23083): Launched 16:36:05.466567 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:06.014788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23085): Launched 16:36:06.334185 run osmo-stp_10.42.42.5(pid=23086): Launched 16:36:06.456845 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:36:07.010735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23088): Launched 16:36:07.132418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:36:07.400863 run patchelf(pid=23089): Launched 16:36:07.581091 run osmo-stp_10.42.42.5(pid=23086): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23086)] 16:36:07.716338 run osmo-stp_10.42.42.5(pid=23086): stdout: | (launched: 2022-12-09_16:36:06.275800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:07.853500 run osmo-stp_10.42.42.5(pid=23086): stderr: | [0;m[38;5;43m20221209163606469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163606469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163606469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163606470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163606470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163606470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163606470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:07.990749 run osmo-stp_10.42.42.5(pid=23086): stdout: | (launched: 2022-12-09_16:36:06.275800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:08.121381 run osmo-stp_10.42.42.5(pid=23086): stderr: | [0;m[38;5;43m20221209163606469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163606469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163606469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163606470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163606470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163606470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163606470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:08.275838 run patchelf(pid=23089): Terminating (SIGINT) 16:36:08.453925 run patchelf(pid=23089): Terminated: ok {rc=0} 16:36:08.582507 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23086): Process ended prematurely: osmo-stp_10.42.42.5(pid=23086) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23086)] [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:36:08.592060 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:36:08.620267 run osmo-hlr_10.42.42.2(pid=23083): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23083)] 16:36:08.670250 run osmo-hlr_10.42.42.2(pid=23083): stdout: | (launched: 2022-12-09_16:36:05.282465) 16:36:08.721818 run osmo-hlr_10.42.42.2(pid=23083): stderr: | [0;m[1;31m20221209163605482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163605482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163605482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163605482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163605482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163605482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163605494 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163605502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163605502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163605502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:08.773741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23082): Terminating (SIGTERM) 16:36:08.815305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23085): Terminating (SIGTERM) 16:36:08.856707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23088): Terminating (SIGTERM) 16:36:08.898432 --- ParallelTerminationStrategy: PID 23082 died... 16:36:08.918207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23082): Terminated: ok {rc=0} 16:36:08.964568 --- ParallelTerminationStrategy: PID 23085 died... 16:36:08.983712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23085): Terminated: ok {rc=0} 16:36:09.029767 --- ParallelTerminationStrategy: PID 23088 died... 16:36:09.049088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23088): Terminated: ok {rc=0} 16:36:09.135636 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:36:10.433893 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:36:10.440263 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:36:10.471136 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:36:10.509986 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:36:10.596773 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:36:10.626240 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:36:10.664849 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:36:11.261185 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:36:11.310812 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:11.322248 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:36:11.388327 tst cs_paging_gprs_active.py: using LAC 22328 16:36:11.518492 tst cs_paging_gprs_active.py: using RAC 143 16:36:11.645452 tst cs_paging_gprs_active.py: using CellId 22328 16:36:11.773060 tst cs_paging_gprs_active.py: using BVCI 22329 16:36:11.890144 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:11.902030 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:11.913604 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:11.925236 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:11.936804 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:11.948802 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:11.961197 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:11.972628 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:11.984358 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:36:12.104739 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:36:12.225827 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:36:12.446793 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:12.772848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23093): Launched 16:36:13.057297 run iperf3-srv_10.42.42.10(pid=23094): Launched 16:36:13.181089 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:36:13.401627 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:13.729119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23095): Launched 16:36:14.014294 run iperf3-srv_10.42.42.10(pid=23096): Launched 16:36:14.138612 tst cs_paging_gprs_active.py:38: start network... 16:36:14.358155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:14.861754 run create_hlr_db(pid=23097): Launched 16:36:14.985830 bus /gobi_6: Setting Powered False 16:36:16.048775 run create_hlr_db(pid=23097): Terminated: ok {rc=0} 16:36:16.501741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23099): Launched 16:36:16.841706 run osmo-hlr_10.42.42.2(pid=23100): Launched 16:36:17.079599 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:17.697984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23102): Launched 16:36:18.022274 run osmo-stp_10.42.42.5(pid=23103): Launched 16:36:18.148490 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:36:18.706011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23105): Launched 16:36:18.831982 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:36:19.114087 run patchelf(pid=23106): Launched 16:36:19.295799 run osmo-stp_10.42.42.5(pid=23103): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23103)] 16:36:19.434269 run osmo-stp_10.42.42.5(pid=23103): stdout: | (launched: 2022-12-09_16:36:17.963336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:19.575084 run osmo-stp_10.42.42.5(pid=23103): stderr: | [0;m[38;5;43m20221209163618152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163618152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163618153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163618153 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163618154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163618154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163618154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:19.715247 run osmo-stp_10.42.42.5(pid=23103): stdout: | (launched: 2022-12-09_16:36:17.963336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:19.848880 run osmo-stp_10.42.42.5(pid=23103): stderr: | [0;m[38;5;43m20221209163618152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163618152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163618153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163618153 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163618154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163618154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163618154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:20.007395 run patchelf(pid=23106): Terminating (SIGINT) 16:36:20.190515 run patchelf(pid=23106): Terminated: ok {rc=0} 16:36:20.322154 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23103): Process ended prematurely: osmo-stp_10.42.42.5(pid=23103) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23103)] [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:36:20.332398 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 16:36:20.361370 run osmo-hlr_10.42.42.2(pid=23100): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23100)] 16:36:20.411844 run osmo-hlr_10.42.42.2(pid=23100): stdout: | (launched: 2022-12-09_16:36:16.769267) 16:36:20.463641 run osmo-hlr_10.42.42.2(pid=23100): stderr: | [0;m[1;31m20221209163617108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163617118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163617119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163617119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163617119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163617119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163617130 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163617138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163617138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163617138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:20.515684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23093): Terminating (SIGTERM) 16:36:20.557505 run iperf3-srv_10.42.42.10(pid=23094): Terminating (SIGTERM) 16:36:20.599157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23095): Terminating (SIGTERM) 16:36:20.640982 run iperf3-srv_10.42.42.10(pid=23096): Terminating (SIGTERM) 16:36:20.683007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23099): Terminating (SIGTERM) 16:36:20.724739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23102): Terminating (SIGTERM) 16:36:20.766568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23105): Terminating (SIGTERM) 16:36:20.808522 --- ParallelTerminationStrategy: PID 23093 died... 16:36:20.828472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23093): Terminated: ok {rc=0} 16:36:20.874712 --- ParallelTerminationStrategy: PID 23094 died... 16:36:20.894066 run iperf3-srv_10.42.42.10(pid=23094): Terminated {rc=256} 16:36:20.939915 --- ParallelTerminationStrategy: PID 23095 died... 16:36:20.959485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23095): Terminated: ok {rc=0} 16:36:21.005440 --- ParallelTerminationStrategy: PID 23096 died... 16:36:21.024877 run iperf3-srv_10.42.42.10(pid=23096): Terminated {rc=256} 16:36:21.070722 --- ParallelTerminationStrategy: PID 23099 died... 16:36:21.090251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23099): Terminated: ok {rc=0} 16:36:21.136314 --- ParallelTerminationStrategy: PID 23102 died... 16:36:21.155783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23102): Terminated: ok {rc=0} 16:36:21.202104 --- ParallelTerminationStrategy: PID 23105 died... 16:36:21.221476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23105): Terminated: ok {rc=0} 16:36:21.308302 bus /gobi_0: Setting Powered False 16:36:22.406579 bus /gobi_0: Setting Powered False 16:36:23.521702 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:36:24.671113 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:24.683368 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:36:24.754865 tst iperf3.py: using LAC 22329 16:36:24.879764 tst iperf3.py: using RAC 144 16:36:25.004079 tst iperf3.py: using CellId 22329 16:36:25.127986 tst iperf3.py: using BVCI 22330 16:36:25.244803 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:25.256436 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:25.267806 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:25.279455 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:25.291175 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:25.302805 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:25.314523 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:25.326079 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:25.337989 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:36:25.456848 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:36:25.676408 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:26.001132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23107): Launched 16:36:26.283724 run iperf3-srv_10.42.42.10(pid=23108): Launched 16:36:26.405568 tst iperf3.py:8: start network... 16:36:26.624392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:27.125807 run create_hlr_db(pid=23109): Launched 16:36:27.250472 bus /gobi_6: Setting Powered False 16:36:28.314491 run create_hlr_db(pid=23109): Terminated: ok {rc=0} 16:36:28.748093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23111): Launched 16:36:29.051614 run osmo-hlr_10.42.42.2(pid=23112): Launched 16:36:29.166459 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:29.702413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23114): Launched 16:36:30.007151 run osmo-stp_10.42.42.5(pid=23115): Launched 16:36:30.122113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:36:30.660843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23117): Launched 16:36:30.777121 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:36:31.045343 run patchelf(pid=23118): Launched 16:36:31.282237 run osmo-stp_10.42.42.5(pid=23115): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23115)] 16:36:31.416282 run osmo-stp_10.42.42.5(pid=23115): stdout: | (launched: 2022-12-09_16:36:29.950861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:31.549996 run osmo-stp_10.42.42.5(pid=23115): stderr: | [0;m[38;5;43m20221209163630122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163630123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163630123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163630123 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163630124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163630124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163630124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:31.685066 run osmo-stp_10.42.42.5(pid=23115): stdout: | (launched: 2022-12-09_16:36:29.950861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:31.812534 run osmo-stp_10.42.42.5(pid=23115): stderr: | [0;m[38;5;43m20221209163630122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163630123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163630123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163630123 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163630124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163630124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163630124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:31.963620 run patchelf(pid=23118): Terminating (SIGINT) 16:36:32.138058 run patchelf(pid=23118): Terminated: ok {rc=0} 16:36:32.263924 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23115): Process ended prematurely: osmo-stp_10.42.42.5(pid=23115) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23115)] [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 16:36:32.274066 tst iperf3.py:8: Test FAILED (7.6 sec) 16:36:32.301931 run osmo-hlr_10.42.42.2(pid=23112): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23112)] 16:36:32.349545 run osmo-hlr_10.42.42.2(pid=23112): stdout: | (launched: 2022-12-09_16:36:28.996011) 16:36:32.398692 run osmo-hlr_10.42.42.2(pid=23112): stderr: | [0;m[1;31m20221209163629173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163629173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163629173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163629173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163629174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163629174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163629186 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163629195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163629195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163629195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:32.448331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23107): Terminating (SIGTERM) 16:36:32.487897 run iperf3-srv_10.42.42.10(pid=23108): Terminating (SIGTERM) 16:36:32.527478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23111): Terminating (SIGTERM) 16:36:32.567100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23114): Terminating (SIGTERM) 16:36:32.606721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23117): Terminating (SIGTERM) 16:36:32.646665 --- ParallelTerminationStrategy: PID 23107 died... 16:36:32.665771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23107): Terminated: ok {rc=0} 16:36:32.709531 --- ParallelTerminationStrategy: PID 23108 died... 16:36:32.728075 run iperf3-srv_10.42.42.10(pid=23108): Terminated {rc=256} 16:36:32.771669 --- ParallelTerminationStrategy: PID 23111 died... 16:36:32.790335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23111): Terminated: ok {rc=0} 16:36:32.834067 --- ParallelTerminationStrategy: PID 23114 died... 16:36:32.852662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23114): Terminated: ok {rc=0} 16:36:32.896289 --- ParallelTerminationStrategy: PID 23117 died... 16:36:32.914923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23117): Terminated: ok {rc=0} 16:36:33.000502 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:36:34.153759 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:34.166082 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:36:34.235608 tst iperf3m4.py: using LAC 22330 16:36:34.361370 tst iperf3m4.py: using RAC 145 16:36:34.486384 tst iperf3m4.py: using CellId 22330 16:36:34.612218 tst iperf3m4.py: using BVCI 22331 16:36:34.729002 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:34.740608 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:34.752011 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:34.763602 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:34.775442 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:34.787158 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:34.798919 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:34.810592 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:34.822429 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:36:34.940480 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:36:35.065169 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:36:35.181496 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:36:35.302666 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:36:35.522768 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:35.849732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23119): Launched 16:36:36.133103 run iperf3-srv_10.42.42.10(pid=23120): Launched 16:36:36.255014 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:36:36.474982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:36.801311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23121): Launched 16:36:37.086024 run iperf3-srv_10.42.42.10(pid=23122): Launched 16:36:37.209481 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:36:37.428587 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:37.755568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23123): Launched 16:36:38.039279 run iperf3-srv_10.42.42.10(pid=23124): Launched 16:36:38.160931 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:36:38.380694 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:36:38.707103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23125): Launched 16:36:38.991786 run iperf3-srv_10.42.42.10(pid=23126): Launched 16:36:39.115969 tst iperf3m4.py:8: start network... 16:36:39.335478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:39.839747 run create_hlr_db(pid=23127): Launched 16:36:39.966091 bus /gobi_6: Setting Powered False 16:36:41.026114 run create_hlr_db(pid=23127): Terminated: ok {rc=0} 16:36:41.481058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23129): Launched 16:36:41.808234 run osmo-hlr_10.42.42.2(pid=23130): Launched 16:36:41.933210 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:42.494812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23132): Launched 16:36:42.821417 run osmo-stp_10.42.42.5(pid=23133): Launched 16:36:42.946815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:36:43.505881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23135): Launched 16:36:43.630894 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:36:43.906045 run patchelf(pid=23136): Launched 16:36:44.087505 run osmo-stp_10.42.42.5(pid=23133): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23133)] 16:36:44.225563 run osmo-stp_10.42.42.5(pid=23133): stdout: | (launched: 2022-12-09_16:36:42.762146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:44.364601 run osmo-stp_10.42.42.5(pid=23133): stderr: | [0;m[38;5;43m20221209163642950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163642951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163642951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163642951 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163642952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163642952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163642952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:44.503630 run osmo-stp_10.42.42.5(pid=23133): stdout: | (launched: 2022-12-09_16:36:42.762146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:44.636167 run osmo-stp_10.42.42.5(pid=23133): stderr: | [0;m[38;5;43m20221209163642950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163642951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163642951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163642951 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163642952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163642952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163642952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:44.794281 run patchelf(pid=23136): Terminating (SIGINT) 16:36:44.976636 run patchelf(pid=23136): Terminated: ok {rc=0} 16:36:45.108864 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23133): Process ended prematurely: osmo-stp_10.42.42.5(pid=23133) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23133)] [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:36:45.119220 tst iperf3m4.py:8: Test FAILED (11.0 sec) 16:36:45.148791 run osmo-hlr_10.42.42.2(pid=23130): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23130)] 16:36:45.199135 run osmo-hlr_10.42.42.2(pid=23130): stdout: | (launched: 2022-12-09_16:36:41.748908) 16:36:45.251639 run osmo-hlr_10.42.42.2(pid=23130): stderr: | [0;m[1;31m20221209163641946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163641946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163641946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163641946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163641946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163641946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163641960 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163641968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163641968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163641968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:45.304246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23119): Terminating (SIGTERM) 16:36:45.346963 run iperf3-srv_10.42.42.10(pid=23120): Terminating (SIGTERM) 16:36:45.389089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23121): Terminating (SIGTERM) 16:36:45.431277 run iperf3-srv_10.42.42.10(pid=23122): Terminating (SIGTERM) 16:36:45.473267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23123): Terminating (SIGTERM) 16:36:45.515456 run iperf3-srv_10.42.42.10(pid=23124): Terminating (SIGTERM) 16:36:45.557718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23125): Terminating (SIGTERM) 16:36:45.599985 run iperf3-srv_10.42.42.10(pid=23126): Terminating (SIGTERM) 16:36:45.642002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23129): Terminating (SIGTERM) 16:36:45.684161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23132): Terminating (SIGTERM) 16:36:45.726385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23135): Terminating (SIGTERM) 16:36:45.768659 --- ParallelTerminationStrategy: PID 23119 died... 16:36:45.788759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23119): Terminated: ok {rc=0} 16:36:45.837196 --- ParallelTerminationStrategy: PID 23120 died... 16:36:45.868645 run iperf3-srv_10.42.42.10(pid=23120): Terminated {rc=256} 16:36:45.920307 --- ParallelTerminationStrategy: PID 23121 died... 16:36:45.940459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23121): Terminated: ok {rc=0} 16:36:45.987936 --- ParallelTerminationStrategy: PID 23122 died... 16:36:46.008210 run iperf3-srv_10.42.42.10(pid=23122): Terminated {rc=256} 16:36:46.055351 --- ParallelTerminationStrategy: PID 23123 died... 16:36:46.075433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23123): Terminated: ok {rc=0} 16:36:46.122952 --- ParallelTerminationStrategy: PID 23124 died... 16:36:46.143070 run iperf3-srv_10.42.42.10(pid=23124): Terminated {rc=256} 16:36:46.190323 --- ParallelTerminationStrategy: PID 23125 died... 16:36:46.210633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23125): Terminated: ok {rc=0} 16:36:46.258151 --- ParallelTerminationStrategy: PID 23126 died... 16:36:46.278286 run iperf3-srv_10.42.42.10(pid=23126): Terminated {rc=256} 16:36:46.325673 --- ParallelTerminationStrategy: PID 23129 died... 16:36:46.345832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23129): Terminated: ok {rc=0} 16:36:46.393340 --- ParallelTerminationStrategy: PID 23132 died... 16:36:46.413578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23132): Terminated: ok {rc=0} 16:36:46.461206 --- ParallelTerminationStrategy: PID 23135 died... 16:36:46.481310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23135): Terminated: ok {rc=0} 16:36:46.576413 bus /gobi_4: Setting Powered False 16:36:47.682137 bus /gobi_4: Setting Powered False 16:36:48.796910 bus /gobi_1: Setting Powered False 16:36:49.895905 bus /gobi_1: Setting Powered False 16:36:51.012416 bus /gobi_0: Setting Powered False 16:36:52.111474 bus /gobi_0: Setting Powered False 16:36:53.227144 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:36:54.330025 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:54.342344 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:36:54.410375 tst ping.py: using LAC 22331 16:36:54.529418 tst ping.py: using RAC 146 16:36:54.655186 tst ping.py: using CellId 22331 16:36:54.779004 tst ping.py: using BVCI 22332 16:36:54.893769 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:54.905494 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:54.916848 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:54.928535 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:54.940209 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:54.951876 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:54.964004 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:36:54.975760 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:36:55.093254 tst ping.py:19: start network... 16:36:55.292158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:55.748335 run create_hlr_db(pid=23137): Launched 16:36:55.870604 bus /gobi_6: Setting Powered False 16:36:56.930398 run create_hlr_db(pid=23137): Terminated: ok {rc=0} 16:36:57.366268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23139): Launched 16:36:57.685970 run osmo-hlr_10.42.42.2(pid=23140): Launched 16:36:57.807358 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:58.361185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23142): Launched 16:36:58.679846 run osmo-stp_10.42.42.5(pid=23143): Launched 16:36:58.801552 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:36:59.351061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23145): Launched 16:36:59.474544 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:36:59.743327 run patchelf(pid=23146): Launched 16:36:59.921167 run osmo-stp_10.42.42.5(pid=23143): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23143)] 16:37:00.056887 run osmo-stp_10.42.42.5(pid=23143): stdout: | (launched: 2022-12-09_16:36:58.621192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:00.193949 run osmo-stp_10.42.42.5(pid=23143): stderr: | [0;m[38;5;43m20221209163658812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163658812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163658813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163658813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163658813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163658813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163658814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:00.331154 run osmo-stp_10.42.42.5(pid=23143): stdout: | (launched: 2022-12-09_16:36:58.621192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:00.461978 run osmo-stp_10.42.42.5(pid=23143): stderr: | [0;m[38;5;43m20221209163658812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163658812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163658813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163658813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163658813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163658813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163658814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:00.617367 run patchelf(pid=23146): Terminating (SIGINT) 16:37:00.795507 run patchelf(pid=23146): Terminated: ok {rc=0} 16:37:00.936435 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23143): Process ended prematurely: osmo-stp_10.42.42.5(pid=23143) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23143)] [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 16:37:00.946563 tst ping.py:22: Test FAILED (6.6 sec) 16:37:00.976733 run osmo-hlr_10.42.42.2(pid=23140): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23140)] 16:37:01.028589 run osmo-hlr_10.42.42.2(pid=23140): stdout: | (launched: 2022-12-09_16:36:57.628044) 16:37:01.081990 run osmo-hlr_10.42.42.2(pid=23140): stderr: | [0;m[1;31m20221209163657826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163657826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163657826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163657826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163657826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163657826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163657839 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163657849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163657849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163657849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:01.136002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23139): Terminating (SIGTERM) 16:37:01.179561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23142): Terminating (SIGTERM) 16:37:01.223670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23145): Terminating (SIGTERM) 16:37:01.269522 --- ParallelTerminationStrategy: PID 23139 died... 16:37:01.290321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23139): Terminated: ok {rc=0} 16:37:01.340046 --- ParallelTerminationStrategy: PID 23142 died... 16:37:01.360595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23142): Terminated: ok {rc=0} 16:37:01.409312 --- ParallelTerminationStrategy: PID 23145 died... 16:37:01.429687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23145): Terminated: ok {rc=0} 16:37:01.520679 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:37:02.609769 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:37:02.623831 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:37:02.696033 tst ping_idle_ping.py: using LAC 22332 16:37:02.812705 tst ping_idle_ping.py: using RAC 147 16:37:02.936775 tst ping_idle_ping.py: using CellId 22332 16:37:03.060105 tst ping_idle_ping.py: using BVCI 22333 16:37:03.177460 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:37:03.189250 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:37:03.200670 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:37:03.212923 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:37:03.225238 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:37:03.238321 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:37:03.249946 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:37:03.262113 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:37:03.382516 tst ping_idle_ping.py:24: start network... 16:37:03.599201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:04.098001 run create_hlr_db(pid=23147): Launched 16:37:04.220153 bus /gobi_6: Setting Powered False 16:37:05.284517 run create_hlr_db(pid=23147): Terminated: ok {rc=0} 16:37:05.710400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23149): Launched 16:37:06.008754 run osmo-hlr_10.42.42.2(pid=23150): Launched 16:37:06.122376 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:06.633906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23152): Launched 16:37:06.930780 run osmo-stp_10.42.42.5(pid=23153): Launched 16:37:07.043826 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:37:07.556254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23155): Launched 16:37:07.670324 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:37:07.922360 run patchelf(pid=23156): Launched 16:37:08.090162 run osmo-stp_10.42.42.5(pid=23153): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23153)] 16:37:08.215809 run osmo-stp_10.42.42.5(pid=23153): stdout: | (launched: 2022-12-09_16:37:06.875754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:08.343342 run osmo-stp_10.42.42.5(pid=23153): stderr: | [0;m[38;5;43m20221209163707047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163707047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163707047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163707048 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163707048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163707048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163707048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:08.471031 run osmo-stp_10.42.42.5(pid=23153): stdout: | (launched: 2022-12-09_16:37:06.875754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:08.592303 run osmo-stp_10.42.42.5(pid=23153): stderr: | [0;m[38;5;43m20221209163707047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163707047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163707047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163707048 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163707048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163707048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163707048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:08.736509 run patchelf(pid=23156): Terminating (SIGINT) 16:37:08.902520 run patchelf(pid=23156): Terminated: ok {rc=0} 16:37:09.022228 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23153): Process ended prematurely: osmo-stp_10.42.42.5(pid=23153) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23153)] [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:37:09.031024 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 16:37:09.057675 run osmo-hlr_10.42.42.2(pid=23150): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23150)] 16:37:09.105090 run osmo-hlr_10.42.42.2(pid=23150): stdout: | (launched: 2022-12-09_16:37:05.954092) 16:37:09.154089 run osmo-hlr_10.42.42.2(pid=23150): stderr: | [0;m[1;31m20221209163706128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163706128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163706128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163706128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163706129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163706129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163706141 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163706150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163706150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163706150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:09.203708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23149): Terminating (SIGTERM) 16:37:09.243119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23152): Terminating (SIGTERM) 16:37:09.282917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23155): Terminating (SIGTERM) 16:37:09.322885 --- ParallelTerminationStrategy: PID 23149 died... 16:37:09.342047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23149): Terminated: ok {rc=0} 16:37:09.386078 --- ParallelTerminationStrategy: PID 23152 died... 16:37:09.404411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23152): Terminated: ok {rc=0} 16:37:09.448172 --- ParallelTerminationStrategy: PID 23155 died... 16:37:09.466888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23155): Terminated: ok {rc=0} 16:37:09.551206 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:37:10.861507 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:37:10.868706 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:37:10.899167 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:37:10.934748 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:37:10.989674 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:37:11.019733 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:37:11.055387 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:37:11.621972 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:37:11.627201 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:37:11.638987 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:37:11.710133 tst switch_tch_pdch.py: using LAC 22333 16:37:11.831430 tst switch_tch_pdch.py: using RAC 148 16:37:11.951324 tst switch_tch_pdch.py: using CellId 22333 16:37:12.072348 tst switch_tch_pdch.py: using BVCI 22334 16:37:12.186593 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:37:12.198423 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:37:12.210207 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:37:12.222580 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:37:12.235089 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:37:12.247213 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:37:12.259424 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:37:12.271399 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:37:12.388851 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:37:12.508302 tst switch_tch_pdch.py:51: start network... 16:37:12.721425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:13.207152 run create_hlr_db(pid=23163): Launched 16:37:13.327676 bus /gobi_6: Setting Powered False 16:37:14.390070 run create_hlr_db(pid=23163): Terminated: ok {rc=0} 16:37:14.814145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23165): Launched 16:37:15.105675 run osmo-hlr_10.42.42.2(pid=23166): Launched 16:37:15.217373 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:15.720331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23168): Launched 16:37:16.051895 run osmo-stp_10.42.42.5(pid=23169): Launched 16:37:16.271793 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:37:16.927245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23171): Launched 16:37:17.052346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:37:17.302670 run patchelf(pid=23172): Launched 16:37:17.465164 run osmo-stp_10.42.42.5(pid=23169): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23169)] 16:37:17.588392 run osmo-stp_10.42.42.5(pid=23169): stdout: | (launched: 2022-12-09_16:37:15.991801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:17.713990 run osmo-stp_10.42.42.5(pid=23169): stderr: | [0;m[38;5;43m20221209163716316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163716316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163716316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163716323 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163716324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163716324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163716324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:17.839666 run osmo-stp_10.42.42.5(pid=23169): stdout: | (launched: 2022-12-09_16:37:15.991801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:17.959466 run osmo-stp_10.42.42.5(pid=23169): stderr: | [0;m[38;5;43m20221209163716316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163716316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163716316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163716323 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163716324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163716324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163716324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:18.102178 run patchelf(pid=23172): Terminating (SIGINT) 16:37:18.265272 run patchelf(pid=23172): Terminated: ok {rc=0} 16:37:18.383954 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23169): Process ended prematurely: osmo-stp_10.42.42.5(pid=23169) [trial-2361↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23169)] [trial-2361↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:37:18.392766 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 16:37:18.419252 run osmo-hlr_10.42.42.2(pid=23166): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23166)] 16:37:18.466215 run osmo-hlr_10.42.42.2(pid=23166): stdout: | (launched: 2022-12-09_16:37:15.051849) 16:37:18.514800 run osmo-hlr_10.42.42.2(pid=23166): stderr: | [0;m[1;31m20221209163715227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163715227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163715227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163715227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163715227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163715227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163715275 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163715284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163715284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163715284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:18.563827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23165): Terminating (SIGTERM) 16:37:18.602804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23168): Terminating (SIGTERM) 16:37:18.641873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23171): Terminating (SIGTERM) 16:37:18.681244 --- ParallelTerminationStrategy: PID 23165 died... 16:37:18.699995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23165): Terminated: ok {rc=0} 16:37:18.743352 --- ParallelTerminationStrategy: PID 23168 died... 16:37:18.762324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23168): Terminated: ok {rc=0} 16:37:18.805329 --- ParallelTerminationStrategy: PID 23171 died... 16:37:18.823605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23171): Terminated: ok {rc=0} 16:37:18.908033 bus /gobi_0: Setting Powered False 16:37:20.007745 bus /gobi_0: Setting Powered False 16:37:21.122572 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:37:22.401400 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:37:22.407029 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:37:22.435375 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:37:22.469616 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:37:22.523238 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:37:22.551858 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:37:22.585382 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:37:23.142960 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:37:23.147936 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:23.159031 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:37:23.223914 tst switch_tch_pdch.py: using LAC 22334 16:37:23.337066 tst switch_tch_pdch.py: using RAC 149 16:37:23.450475 tst switch_tch_pdch.py: using CellId 22334 16:37:23.564256 tst switch_tch_pdch.py: using BVCI 22335 16:37:23.676924 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:23.688137 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:23.699062 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:23.709986 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:23.720746 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:23.731831 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:23.742866 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:37:23.753796 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:37:23.870262 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:37:23.986161 tst switch_tch_pdch.py:51: start network... 16:37:24.197977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:24.654596 run create_hlr_db(pid=23176): Launched 16:37:24.774855 bus /gobi_6: Setting Powered False 16:37:25.836431 run create_hlr_db(pid=23176): Terminated: ok {rc=0} 16:37:26.231312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23178): Launched 16:37:26.521449 run osmo-hlr_10.42.42.2(pid=23179): Launched 16:37:26.633135 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:27.106480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23181): Launched 16:37:27.396889 run osmo-stp_10.42.42.5(pid=23182): Launched 16:37:27.507920 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:37:27.983570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23184): Launched 16:37:28.095313 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:37:28.339625 run patchelf(pid=23185): Launched 16:37:28.501925 run osmo-stp_10.42.42.5(pid=23182): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23182)] 16:37:28.625277 run osmo-stp_10.42.42.5(pid=23182): stdout: | (launched: 2022-12-09_16:37:27.343602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:28.750295 run osmo-stp_10.42.42.5(pid=23182): stderr: | [0;m[38;5;43m20221209163727513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163727514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163727514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163727514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163727515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163727515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163727515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:28.875541 run osmo-stp_10.42.42.5(pid=23182): stdout: | (launched: 2022-12-09_16:37:27.343602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:28.994729 run osmo-stp_10.42.42.5(pid=23182): stderr: | [0;m[38;5;43m20221209163727513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163727514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163727514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163727514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163727515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163727515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163727515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:29.136619 run patchelf(pid=23185): Terminating (SIGINT) 16:37:29.299670 run patchelf(pid=23185): Terminated: ok {rc=0} 16:37:29.417315 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23182): Process ended prematurely: osmo-stp_10.42.42.5(pid=23182) [trial-2361↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23182)] [trial-2361↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:37:29.425801 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 16:37:29.451983 run osmo-hlr_10.42.42.2(pid=23179): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23179)] 16:37:29.498631 run osmo-hlr_10.42.42.2(pid=23179): stdout: | (launched: 2022-12-09_16:37:26.468483) 16:37:29.547037 run osmo-hlr_10.42.42.2(pid=23179): stderr: | [0;m[1;31m20221209163726641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163726641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163726641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163726641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163726641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163726641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163726653 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163726663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163726663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163726663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:29.595746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23178): Terminating (SIGTERM) 16:37:29.634751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23181): Terminating (SIGTERM) 16:37:29.673878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23184): Terminating (SIGTERM) 16:37:29.713316 --- ParallelTerminationStrategy: PID 23178 died... 16:37:29.732075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23178): Terminated: ok {rc=0} 16:37:29.775462 --- ParallelTerminationStrategy: PID 23181 died... 16:37:29.793769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23181): Terminated: ok {rc=0} 16:37:29.836765 --- ParallelTerminationStrategy: PID 23184 died... 16:37:29.855040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23184): Terminated: ok {rc=0} 16:37:29.937460 bus /gobi_0: Setting Powered False 16:37:31.035459 bus /gobi_0: Setting Powered False 16:37:32.161679 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_sms:nanobts --------------------------------------------------------------------- 16:37:33.411323 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:37:33.415663 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 16:37:33.438895 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 16:37:33.445622 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 16:37:33.496715 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 16:37:33.519825 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 16:37:33.526363 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 16:37:34.063446 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 16:37:34.068308 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 16:37:34.078938 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 16:37:34.116251 tst mo_mt_sms.py: using LAC 22335 16:37:34.229768 tst mo_mt_sms.py: using RAC 150 16:37:34.342490 tst mo_mt_sms.py: using CellId 22335 16:37:34.458797 tst mo_mt_sms.py: using BVCI 22336 16:37:34.564027 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 16:37:34.679429 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 16:37:34.798562 tst mo_mt_sms.py:9: start nitb and bts... 16:37:35.007609 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:37:35.638853 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23189): Launched 16:37:35.951951 run osmo-nitb_10.42.42.2(pid=23191): Launched 16:37:36.123765 run osmo-nitb_10.42.42.2(pid=23191): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23191)] 16:37:36.263612 run osmo-nitb_10.42.42.2(pid=23191): stdout: | (launched: 2022-12-09_16:37:35.896088) 16:37:36.404523 run osmo-nitb_10.42.42.2(pid=23191): stderr: | (launched: 2022-12-09_16:37:35.942079) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:37:36.545833 run osmo-nitb_10.42.42.2(pid=23191): stdout: | (launched: 2022-12-09_16:37:35.896088) 16:37:36.680942 run osmo-nitb_10.42.42.2(pid=23191): stderr: | (launched: 2022-12-09_16:37:35.942079) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23191): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23191) [trial-2361↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23191)] 16:37:37.069502 tst osmo-nitb_10.42.42.2(pid=23191): stdout: | (launched: 2022-12-09_16:37:35.896088) 16:37:37.194480 tst osmo-nitb_10.42.42.2(pid=23191): stderr: | (launched: 2022-12-09_16:37:35.942079) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:37:37.342887 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=23191): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23191) [trial-2361↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23191)] [trial-2361↪nitb_sms:nanobts↪mo_mt_sms.py:11] 16:37:37.351829 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 16:37:37.358686 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23189): Terminating (SIGTERM) 16:37:37.569302 --- ParallelTerminationStrategy: PID 23189 died... 16:37:37.590211 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23189): Terminated: ok {rc=0} 16:37:37.676739 bus /sierra_3: Setting Powered False 16:37:38.776306 bus /sierra_3: Setting Powered False 16:37:39.891135 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 sms:nanobts+band-1900 --------------------------------------------------------------------- 16:37:41.074243 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:37:41.079570 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 16:37:41.104333 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 16:37:41.131423 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 16:37:41.185645 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 16:37:41.210274 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 16:37:41.237392 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 16:37:41.785530 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 16:37:41.790571 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:41.801679 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:37:41.839924 tst mo_mt_sms.py: using LAC 22336 16:37:41.958463 tst mo_mt_sms.py: using RAC 151 16:37:42.077379 tst mo_mt_sms.py: using CellId 22336 16:37:42.197091 tst mo_mt_sms.py: using BVCI 22337 16:37:42.308217 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:42.319304 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:42.330244 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:42.341407 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:42.352447 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:42.363486 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 16:37:42.475974 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 16:37:42.592620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:43.038359 run create_hlr_db(pid=23195): Launched 16:37:43.159823 bus /sierra_2: Setting Powered False 16:37:44.220793 run create_hlr_db(pid=23195): Terminated: ok {rc=0} 16:37:44.655747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23197): Launched 16:37:44.965385 run osmo-hlr_10.42.42.2(pid=23198): Launched 16:37:45.085035 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:45.620868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23200): Launched 16:37:45.937951 run osmo-stp_10.42.42.5(pid=23201): Launched 16:37:46.117173 run osmo-msc_10.42.42.6: Starting osmo-msc 16:37:46.794811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23203): Launched 16:37:47.198254 run osmo-msc_10.42.42.6(pid=23204): Launched 16:37:47.429635 run osmo-stp_10.42.42.5(pid=23201): ERR: Terminated: ERROR {rc=1} [trial-2361↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23201)] 16:37:47.605137 run osmo-stp_10.42.42.5(pid=23201): stdout: | (launched: 2022-12-09_16:37:45.877397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:47.741135 run osmo-stp_10.42.42.5(pid=23201): stderr: | [0;m[38;5;43m20221209163746225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163746225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163746226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163746226 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163746227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163746227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163746227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:47.872169 run osmo-stp_10.42.42.5(pid=23201): stdout: | (launched: 2022-12-09_16:37:45.877397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:47.996326 run osmo-stp_10.42.42.5(pid=23201): stderr: | [0;m[38;5;43m20221209163746225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163746225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163746226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163746226 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163746227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163746227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163746227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:48.144485 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23201): Process ended prematurely: osmo-stp_10.42.42.5(pid=23201) [trial-2361↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23201)] [trial-2361↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 16:37:48.153383 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 16:37:48.180671 run osmo-hlr_10.42.42.2(pid=23198): ERR: Terminated: ERROR {rc=237} [trial-2361↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23198)] 16:37:48.230421 run osmo-hlr_10.42.42.2(pid=23198): stdout: | (launched: 2022-12-09_16:37:44.909588) 16:37:48.281676 run osmo-hlr_10.42.42.2(pid=23198): stderr: | [0;m[1;31m20221209163745100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163745100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163745100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163745100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163745100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163745100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163745111 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163745120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163745120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163745120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:48.352825 run osmo-msc_10.42.42.6(pid=23204): ERR: Terminated: ERROR {rc=2} [trial-2361↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23204)] 16:37:48.402176 run osmo-msc_10.42.42.6(pid=23204): stdout: | (launched: 2022-12-09_16:37:47.127083) 16:37:48.453363 run osmo-msc_10.42.42.6(pid=23204): stderr: | [0;m[38;5;43m20221209163747612 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163747612 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2f735f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163747612 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163747613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163747613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163747613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163747615 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163747615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163747615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163747615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:37:48.504795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23197): Terminating (SIGTERM) 16:37:48.546226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23200): Terminating (SIGTERM) 16:37:48.587579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23203): Terminating (SIGTERM) 16:37:48.629195 --- ParallelTerminationStrategy: PID 23197 died... 16:37:48.648784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23197): Terminated: ok {rc=0} 16:37:48.695048 --- ParallelTerminationStrategy: PID 23200 died... 16:37:48.714314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23200): Terminated: ok {rc=0} 16:37:48.760287 --- ParallelTerminationStrategy: PID 23203 died... 16:37:48.779556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23203): Terminated: ok {rc=0} 16:37:48.866819 bus /sierra_3: Setting Powered False 16:37:49.964720 bus /sierra_3: Setting Powered False 16:37:51.081567 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 16:37:52.300310 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:37:52.305068 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 16:37:52.328840 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 16:37:52.335980 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 16:37:52.370321 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 16:37:52.393637 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 16:37:52.400158 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 16:37:52.919850 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2361 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 16:37:52.924853 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 16:37:52.935992 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:37:52.974495 tst assert_extension.py: using LAC 22337 16:37:53.088689 tst assert_extension.py: using RAC 152 16:37:53.203229 tst assert_extension.py: using CellId 22337 16:37:53.321716 tst assert_extension.py: using BVCI 22338 16:37:53.427125 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 16:37:53.543589 tst assert_extension.py:10: start nitb and bts... 16:37:53.753681 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:37:54.384747 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23209): Launched 16:37:54.693586 run osmo-nitb_10.42.42.2(pid=23210): Launched 16:37:54.864474 run osmo-nitb_10.42.42.2(pid=23210): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23210)] 16:37:55.003371 run osmo-nitb_10.42.42.2(pid=23210): stdout: | (launched: 2022-12-09_16:37:54.637682) 16:37:55.143731 run osmo-nitb_10.42.42.2(pid=23210): stderr: | (launched: 2022-12-09_16:37:54.683560) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:37:55.283945 run osmo-nitb_10.42.42.2(pid=23210): stdout: | (launched: 2022-12-09_16:37:54.637682) 16:37:55.418401 run osmo-nitb_10.42.42.2(pid=23210): stderr: | (launched: 2022-12-09_16:37:54.683560) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23210): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23210) [trial-2361↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23210)] 16:37:55.810262 tst osmo-nitb_10.42.42.2(pid=23210): stdout: | (launched: 2022-12-09_16:37:54.637682) 16:37:55.936073 tst osmo-nitb_10.42.42.2(pid=23210): stderr: | (launched: 2022-12-09_16:37:54.683560) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:37:56.084565 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23210): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23210) [trial-2361↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23210)] [trial-2361↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 16:37:56.093514 tst assert_extension.py:12: Test FAILED (3.2 sec) 16:37:56.100569 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23209): Terminating (SIGTERM) 16:37:56.311469 --- ParallelTerminationStrategy: PID 23209 died... 16:37:56.332855 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23209): Terminated: ok {rc=0} 16:37:56.419500 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 ussd:nanobts+band-1900 --------------------------------------------------------------------- 16:37:57.589121 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:37:57.594738 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 16:37:57.619642 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 16:37:57.647007 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 16:37:57.684013 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 16:37:57.707391 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 16:37:57.733624 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 16:37:58.261444 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2361 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 16:37:58.266470 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:58.277043 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:37:58.313966 tst assert_extension.py: using LAC 22338 16:37:58.425169 tst assert_extension.py: using RAC 153 16:37:58.536667 tst assert_extension.py: using CellId 22338 16:37:58.648198 tst assert_extension.py: using BVCI 22339 16:37:58.751939 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:58.762502 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:58.772905 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:58.783299 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:58.793728 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:37:58.804052 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 16:37:58.919691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:59.399381 run create_hlr_db(pid=23214): Launched 16:37:59.517983 bus /sierra_2: Setting Powered False 16:38:00.579499 run create_hlr_db(pid=23214): Terminated: ok {rc=0} 16:38:01.058700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23216): Launched 16:38:01.384061 run osmo-hlr_10.42.42.2(pid=23217): Launched 16:38:01.628754 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:02.359434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23251): Launched 16:38:02.743780 run osmo-stp_10.42.42.5(pid=23262): Launched 16:38:02.992621 run osmo-msc_10.42.42.6: Starting osmo-msc 16:38:03.806919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23354): Launched 16:38:04.197977 run osmo-msc_10.42.42.6(pid=23400): Launched 16:38:04.576902 run osmo-stp_10.42.42.5(pid=23262): ERR: Terminated: ERROR {rc=1} [trial-2361↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23262)] 16:38:04.903582 run osmo-stp_10.42.42.5(pid=23262): stdout: | (launched: 2022-12-09_16:38:02.675227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:05.202571 run osmo-stp_10.42.42.5(pid=23262): stderr: | [0;m[38;5;43m20221209163803028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163803028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163803028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163803033 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163803034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163803034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163803034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:05.336727 run osmo-stp_10.42.42.5(pid=23262): stdout: | (launched: 2022-12-09_16:38:02.675227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:05.464772 run osmo-stp_10.42.42.5(pid=23262): stderr: | [0;m[38;5;43m20221209163803028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163803028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163803028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163803033 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163803034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163803034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163803034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:05.617543 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23262): Process ended prematurely: osmo-stp_10.42.42.5(pid=23262) [trial-2361↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23262)] [trial-2361↪ussd:nanobts+band-1900↪assert_extension.py:17] 16:38:05.627323 tst assert_extension.py:17: Test FAILED (7.4 sec) 16:38:05.657859 run osmo-hlr_10.42.42.2(pid=23217): ERR: Terminated: ERROR {rc=237} [trial-2361↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23217)] 16:38:05.710631 run osmo-hlr_10.42.42.2(pid=23217): stdout: | (launched: 2022-12-09_16:38:01.314426) 16:38:05.764326 run osmo-hlr_10.42.42.2(pid=23217): stderr: | [0;m[1;31m20221209163801597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163801597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163801597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163801597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163801597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163801597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163801618 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163801626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163801626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163801627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:05.838652 run osmo-msc_10.42.42.6(pid=23400): ERR: Terminated: ERROR {rc=2} [trial-2361↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23400)] 16:38:05.890675 run osmo-msc_10.42.42.6(pid=23400): stdout: | (launched: 2022-12-09_16:38:04.116662) 16:38:05.944638 run osmo-msc_10.42.42.6(pid=23400): stderr: | [0;m[38;5;43m20221209163804803 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163804804 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f279b6f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163804804 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163804804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163804804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163804804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163804817 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163804818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163804818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163804818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:38:05.999395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23216): Terminating (SIGTERM) 16:38:06.043826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23251): Terminating (SIGTERM) 16:38:06.089625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23354): Terminating (SIGTERM) 16:38:06.135761 --- ParallelTerminationStrategy: PID 23216 died... 16:38:06.156495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23216): Terminated: ok {rc=0} 16:38:06.207326 --- ParallelTerminationStrategy: PID 23251 died... 16:38:06.227789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23251): Terminated: ok {rc=0} 16:38:06.277210 --- ParallelTerminationStrategy: PID 23354 died... 16:38:06.297694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23354): Terminated: ok {rc=0} 16:38:06.389360 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:38:07.594867 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:38:07.603498 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:38:07.633352 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:38:07.662455 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:38:07.715979 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:38:07.741298 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:38:07.771004 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:38:08.323075 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:38:08.379362 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:38:08.392000 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:38:08.455125 tst mo_mt_call.py: using LAC 22339 16:38:08.580826 tst mo_mt_call.py: using RAC 154 16:38:08.708587 tst mo_mt_call.py: using CellId 22339 16:38:08.834164 tst mo_mt_call.py: using BVCI 22340 16:38:08.953135 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:38:08.966024 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:38:08.979532 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:38:08.993523 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:38:09.006135 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:38:09.020558 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:38:09.145821 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:38:09.269686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:09.776708 run create_hlr_db(pid=23500): Launched 16:38:09.940085 bus /sierra_2: Setting Powered False 16:38:11.004665 run create_hlr_db(pid=23500): Terminated: ok {rc=0} 16:38:11.466710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23502): Launched 16:38:11.812901 run osmo-hlr_10.42.42.2(pid=23503): Launched 16:38:12.058863 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:12.728198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23505): Launched 16:38:13.071832 run osmo-stp_10.42.42.5(pid=23506): Launched 16:38:13.357871 run osmo-msc_10.42.42.6: Starting osmo-msc 16:38:13.957868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23508): Launched 16:38:14.305069 run osmo-msc_10.42.42.6(pid=23509): Launched 16:38:14.674524 run osmo-stp_10.42.42.5(pid=23506): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23506)] 16:38:14.950009 run osmo-stp_10.42.42.5(pid=23506): stdout: | (launched: 2022-12-09_16:38:13.008058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:15.129216 run osmo-stp_10.42.42.5(pid=23506): stderr: | [0;m[38;5;43m20221209163813198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163813198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163813198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163813198 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163813199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163813199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163813199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:15.269347 run osmo-stp_10.42.42.5(pid=23506): stdout: | (launched: 2022-12-09_16:38:13.008058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:15.401764 run osmo-stp_10.42.42.5(pid=23506): stderr: | [0;m[38;5;43m20221209163813198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163813198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163813198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163813198 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163813199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163813199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163813199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:15.561582 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23506): Process ended prematurely: osmo-stp_10.42.42.5(pid=23506) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23506)] [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:38:15.571958 tst mo_mt_call.py:8: Test FAILED (7.2 sec) 16:38:15.603707 run osmo-hlr_10.42.42.2(pid=23503): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23503)] 16:38:15.657179 run osmo-hlr_10.42.42.2(pid=23503): stdout: | (launched: 2022-12-09_16:38:11.752207) 16:38:15.711387 run osmo-hlr_10.42.42.2(pid=23503): stderr: | [0;m[1;31m20221209163812063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163812063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163812064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163812064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163812064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163812064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163812079 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163812095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163812095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163812095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:15.786371 run osmo-msc_10.42.42.6(pid=23509): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23509)] 16:38:15.842990 run osmo-msc_10.42.42.6(pid=23509): stdout: | (launched: 2022-12-09_16:38:14.240867) 16:38:15.920900 run osmo-msc_10.42.42.6(pid=23509): stderr: | [0;m[38;5;43m20221209163814746 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163814747 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdfc4540c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163814747 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163814747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163814747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163814747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163814751 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163814751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163814751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163814751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:38:15.983312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23502): Terminating (SIGTERM) 16:38:16.042739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23505): Terminating (SIGTERM) 16:38:16.093553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23508): Terminating (SIGTERM) 16:38:16.139987 --- ParallelTerminationStrategy: PID 23502 died... 16:38:16.160753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23502): Terminated: ok {rc=0} 16:38:16.211655 --- ParallelTerminationStrategy: PID 23505 died... 16:38:16.233059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23505): Terminated: ok {rc=0} 16:38:16.282000 --- ParallelTerminationStrategy: PID 23508 died... 16:38:16.302801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23508): Terminated: ok {rc=0} 16:38:16.418151 bus /sierra_3: Setting Powered False 16:38:17.569535 bus /sierra_3: Setting Powered False 16:38:18.702930 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:38:19.859970 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:38:19.873649 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:38:19.937684 tst mo_mt_call_osmux.py: using LAC 22340 16:38:20.069437 tst mo_mt_call_osmux.py: using RAC 155 16:38:20.198303 tst mo_mt_call_osmux.py: using CellId 22340 16:38:20.328292 tst mo_mt_call_osmux.py: using BVCI 22341 16:38:20.450525 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:38:20.463351 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:38:20.476197 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:38:20.490390 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:38:20.504050 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:38:20.517374 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:38:20.644162 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:38:20.771965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:21.289667 run create_hlr_db(pid=23511): Launched 16:38:21.455835 bus /sierra_2: Setting Powered False 16:38:22.520430 run create_hlr_db(pid=23511): Terminated: ok {rc=0} 16:38:22.985249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23513): Launched 16:38:23.330964 run osmo-hlr_10.42.42.2(pid=23514): Launched 16:38:23.584006 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:24.257477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23516): Launched 16:38:24.607172 run osmo-stp_10.42.42.5(pid=23517): Launched 16:38:24.858065 run osmo-msc_10.42.42.6: Starting osmo-msc 16:38:25.434611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23519): Launched 16:38:25.734363 run osmo-msc_10.42.42.6(pid=23520): Launched 16:38:25.901622 run osmo-stp_10.42.42.5(pid=23517): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23517)] 16:38:26.027630 run osmo-stp_10.42.42.5(pid=23517): stdout: | (launched: 2022-12-09_16:38:24.542580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:26.154332 run osmo-stp_10.42.42.5(pid=23517): stderr: | [0;m[38;5;43m20221209163824847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163824848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163824848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163824848 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163824849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163824849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163824849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:26.279003 run osmo-stp_10.42.42.5(pid=23517): stdout: | (launched: 2022-12-09_16:38:24.542580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:26.397854 run osmo-stp_10.42.42.5(pid=23517): stderr: | [0;m[38;5;43m20221209163824847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163824848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163824848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163824848 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163824849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163824849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163824849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:26.541241 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23517): Process ended prematurely: osmo-stp_10.42.42.5(pid=23517) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23517)] [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:38:26.550055 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 16:38:26.576021 run osmo-hlr_10.42.42.2(pid=23514): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23514)] 16:38:26.622975 run osmo-hlr_10.42.42.2(pid=23514): stdout: | (launched: 2022-12-09_16:38:23.269517) 16:38:26.671739 run osmo-hlr_10.42.42.2(pid=23514): stderr: | [0;m[1;31m20221209163823574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163823574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163823574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163823574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163823574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163823574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163823594 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163823602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163823602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163823603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:26.739935 run osmo-msc_10.42.42.6(pid=23520): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23520)] 16:38:26.786775 run osmo-msc_10.42.42.6(pid=23520): stdout: | (launched: 2022-12-09_16:38:25.679484) 16:38:26.835387 run osmo-msc_10.42.42.6(pid=23520): stderr: | [0;m[38;5;43m20221209163825949 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163825949 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba65547c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163825949 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163825949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163825950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163825950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163825952 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163825953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163825953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163825953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:38:26.884886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23513): Terminating (SIGTERM) 16:38:26.924018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23516): Terminating (SIGTERM) 16:38:26.963154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23519): Terminating (SIGTERM) 16:38:27.002604 --- ParallelTerminationStrategy: PID 23513 died... 16:38:27.021504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23513): Terminated: ok {rc=0} 16:38:27.065114 --- ParallelTerminationStrategy: PID 23516 died... 16:38:27.083500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23516): Terminated: ok {rc=0} 16:38:27.126634 --- ParallelTerminationStrategy: PID 23519 died... 16:38:27.144858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23519): Terminated: ok {rc=0} 16:38:27.226926 bus /sierra_3: Setting Powered False 16:38:28.324227 bus /sierra_3: Setting Powered False 16:38:29.439546 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:38:30.679547 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:38:30.688399 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:38:30.713142 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:38:30.741090 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:38:30.794228 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:38:30.818385 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:38:30.852464 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:38:31.439312 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:38:31.497986 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:31.510836 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:38:31.575350 tst mo_mt_call.py: using LAC 22341 16:38:31.707483 tst mo_mt_call.py: using RAC 156 16:38:31.838987 tst mo_mt_call.py: using CellId 22341 16:38:31.960808 tst mo_mt_call.py: using BVCI 22342 16:38:32.107443 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:32.121839 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:32.137345 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:32.152553 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:32.167089 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:32.181206 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:38:32.316264 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:38:32.436614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:32.937345 run create_hlr_db(pid=23525): Launched 16:38:33.060191 bus /sierra_2: Setting Powered False 16:38:34.123918 run create_hlr_db(pid=23525): Terminated: ok {rc=0} 16:38:34.571050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23527): Launched 16:38:34.892122 run osmo-hlr_10.42.42.2(pid=23529): Launched 16:38:35.015521 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:35.571116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23531): Launched 16:38:35.896623 run osmo-stp_10.42.42.5(pid=23532): Launched 16:38:36.020808 run osmo-msc_10.42.42.6: Starting osmo-msc 16:38:36.603136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23534): Launched 16:38:36.925654 run osmo-msc_10.42.42.6(pid=23535): Launched 16:38:37.106144 run osmo-stp_10.42.42.5(pid=23532): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23532)] 16:38:37.242091 run osmo-stp_10.42.42.5(pid=23532): stdout: | (launched: 2022-12-09_16:38:35.837684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:37.379155 run osmo-stp_10.42.42.5(pid=23532): stderr: | [0;m[38;5;43m20221209163836028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163836029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163836029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163836029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163836030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163836030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163836030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:37.515393 run osmo-stp_10.42.42.5(pid=23532): stdout: | (launched: 2022-12-09_16:38:35.837684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:37.643545 run osmo-stp_10.42.42.5(pid=23532): stderr: | [0;m[38;5;43m20221209163836028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163836029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163836029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163836029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163836030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163836030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163836030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:37.796486 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23532): Process ended prematurely: osmo-stp_10.42.42.5(pid=23532) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23532)] [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:38:37.806014 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:38:37.834120 run osmo-hlr_10.42.42.2(pid=23529): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23529)] 16:38:37.884045 run osmo-hlr_10.42.42.2(pid=23529): stdout: | (launched: 2022-12-09_16:38:34.834116) 16:38:37.935409 run osmo-hlr_10.42.42.2(pid=23529): stderr: | [0;m[1;31m20221209163835030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163835030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163835030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163835030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163835030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163835030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163835042 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163835052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163835052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163835052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:38.008053 run osmo-msc_10.42.42.6(pid=23535): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23535)] 16:38:38.057977 run osmo-msc_10.42.42.6(pid=23535): stdout: | (launched: 2022-12-09_16:38:36.867100) 16:38:38.109488 run osmo-msc_10.42.42.6(pid=23535): stderr: | [0;m[38;5;43m20221209163837188 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163837188 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fca5aca0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163837188 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163837188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163837188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163837188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163837190 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163837190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163837191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163837191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:38:38.161310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23527): Terminating (SIGTERM) 16:38:38.202818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23531): Terminating (SIGTERM) 16:38:38.244297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23534): Terminating (SIGTERM) 16:38:38.286250 --- ParallelTerminationStrategy: PID 23527 died... 16:38:38.306197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23527): Terminated: ok {rc=0} 16:38:38.352472 --- ParallelTerminationStrategy: PID 23531 died... 16:38:38.371766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23531): Terminated: ok {rc=0} 16:38:38.417655 --- ParallelTerminationStrategy: PID 23534 died... 16:38:38.436890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23534): Terminated: ok {rc=0} 16:38:38.525313 bus /sierra_3: Setting Powered False 16:38:39.623910 bus /sierra_3: Setting Powered False 16:38:40.738689 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:38:41.886891 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:41.899292 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:38:41.960455 tst mo_mt_call_osmux.py: using LAC 22342 16:38:42.087461 tst mo_mt_call_osmux.py: using RAC 157 16:38:42.214319 tst mo_mt_call_osmux.py: using CellId 22342 16:38:42.340726 tst mo_mt_call_osmux.py: using BVCI 22343 16:38:42.456774 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:42.468355 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:42.479793 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:42.491493 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:42.503203 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:38:42.514825 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:38:42.632569 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:38:42.747574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:43.212540 run create_hlr_db(pid=23537): Launched 16:38:43.336857 bus /sierra_2: Setting Powered False 16:38:44.401026 run create_hlr_db(pid=23537): Terminated: ok {rc=0} 16:38:44.848274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23539): Launched 16:38:45.169764 run osmo-hlr_10.42.42.2(pid=23540): Launched 16:38:45.291384 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:45.853716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23542): Launched 16:38:46.177687 run osmo-stp_10.42.42.5(pid=23543): Launched 16:38:46.409861 run osmo-msc_10.42.42.6: Starting osmo-msc 16:38:47.089605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23545): Launched 16:38:47.404239 run osmo-msc_10.42.42.6(pid=23546): Launched 16:38:47.576922 run osmo-stp_10.42.42.5(pid=23543): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23543)] 16:38:47.706370 run osmo-stp_10.42.42.5(pid=23543): stdout: | (launched: 2022-12-09_16:38:46.118868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:47.833684 run osmo-stp_10.42.42.5(pid=23543): stderr: | [0;m[38;5;43m20221209163846454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163846454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163846454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163846455 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163846455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163846455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163846455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:47.958413 run osmo-stp_10.42.42.5(pid=23543): stdout: | (launched: 2022-12-09_16:38:46.118868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:48.077416 run osmo-stp_10.42.42.5(pid=23543): stderr: | [0;m[38;5;43m20221209163846454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163846454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163846454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163846455 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163846455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163846455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163846455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:48.220095 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23543): Process ended prematurely: osmo-stp_10.42.42.5(pid=23543) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23543)] [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:38:48.228935 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:38:48.254974 run osmo-hlr_10.42.42.2(pid=23540): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23540)] 16:38:48.302036 run osmo-hlr_10.42.42.2(pid=23540): stdout: | (launched: 2022-12-09_16:38:45.111435) 16:38:48.351312 run osmo-hlr_10.42.42.2(pid=23540): stderr: | [0;m[1;31m20221209163845309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163845309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163845309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163845309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163845309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163845309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163845322 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163845330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163845331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163845331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:48.419552 run osmo-msc_10.42.42.6(pid=23546): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23546)] 16:38:48.466555 run osmo-msc_10.42.42.6(pid=23546): stdout: | (launched: 2022-12-09_16:38:47.349360) 16:38:48.515110 run osmo-msc_10.42.42.6(pid=23546): stderr: | [0;m[38;5;43m20221209163847621 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163847621 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f09fe822c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163847621 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163847621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163847621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163847621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163847623 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163847624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163847624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163847624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:38:48.564313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23539): Terminating (SIGTERM) 16:38:48.603503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23542): Terminating (SIGTERM) 16:38:48.642578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23545): Terminating (SIGTERM) 16:38:48.682758 --- ParallelTerminationStrategy: PID 23539 died... 16:38:48.701393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23539): Terminated: ok {rc=0} 16:38:48.744835 --- ParallelTerminationStrategy: PID 23542 died... 16:38:48.763262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23542): Terminated: ok {rc=0} 16:38:48.806908 --- ParallelTerminationStrategy: PID 23545 died... 16:38:48.825446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23545): Terminated: ok {rc=0} 16:38:48.911928 bus /sierra_3: Setting Powered False 16:38:50.010402 bus /sierra_3: Setting Powered False 16:38:51.126497 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:38:52.362808 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:38:52.369909 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:38:52.393371 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:38:52.419610 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:38:52.471958 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:38:52.496421 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:38:52.522629 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:38:53.072365 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:38:53.120268 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:53.131453 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:38:53.191400 tst mo_mt_call.py: using LAC 22343 16:38:53.309885 tst mo_mt_call.py: using RAC 158 16:38:53.428637 tst mo_mt_call.py: using CellId 22343 16:38:53.545725 tst mo_mt_call.py: using BVCI 22344 16:38:53.662846 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:53.674962 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:53.686602 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:53.698785 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:53.711285 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:38:53.723029 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:38:53.845123 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:38:53.962836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:54.425281 run create_hlr_db(pid=23551): Launched 16:38:54.549215 bus /sierra_2: Setting Powered False 16:38:55.609161 run create_hlr_db(pid=23551): Terminated: ok {rc=0} 16:38:56.026077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23553): Launched 16:38:56.325395 run osmo-hlr_10.42.42.2(pid=23554): Launched 16:38:56.438333 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:56.955445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23556): Launched 16:38:57.255809 run osmo-stp_10.42.42.5(pid=23557): Launched 16:38:57.369951 run osmo-msc_10.42.42.6: Starting osmo-msc 16:38:57.910167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23559): Launched 16:38:58.210587 run osmo-msc_10.42.42.6(pid=23560): Launched 16:38:58.377844 run osmo-stp_10.42.42.5(pid=23557): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23557)] 16:38:58.503989 run osmo-stp_10.42.42.5(pid=23557): stdout: | (launched: 2022-12-09_16:38:57.201075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:58.630091 run osmo-stp_10.42.42.5(pid=23557): stderr: | [0;m[38;5;43m20221209163857371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163857372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163857372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163857372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163857373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163857373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163857373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:58.754897 run osmo-stp_10.42.42.5(pid=23557): stdout: | (launched: 2022-12-09_16:38:57.201075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:58.874505 run osmo-stp_10.42.42.5(pid=23557): stderr: | [0;m[38;5;43m20221209163857371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163857372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163857372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163857372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163857373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163857373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163857373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:59.016745 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23557): Process ended prematurely: osmo-stp_10.42.42.5(pid=23557) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23557)] [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:38:59.025651 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 16:38:59.051597 run osmo-hlr_10.42.42.2(pid=23554): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23554)] 16:38:59.098446 run osmo-hlr_10.42.42.2(pid=23554): stdout: | (launched: 2022-12-09_16:38:56.270296) 16:38:59.147510 run osmo-hlr_10.42.42.2(pid=23554): stderr: | [0;m[1;31m20221209163856445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163856445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163856445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163856445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163856445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163856446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163856458 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163856469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163856469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163856469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:59.215696 run osmo-msc_10.42.42.6(pid=23560): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23560)] 16:38:59.262944 run osmo-msc_10.42.42.6(pid=23560): stdout: | (launched: 2022-12-09_16:38:58.155440) 16:38:59.311251 run osmo-msc_10.42.42.6(pid=23560): stderr: | [0;m[38;5;43m20221209163858426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163858426 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f30d53d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163858426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163858426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163858426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163858426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163858428 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163858429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163858429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163858429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:38:59.359851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23553): Terminating (SIGTERM) 16:38:59.398591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23556): Terminating (SIGTERM) 16:38:59.437655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23559): Terminating (SIGTERM) 16:38:59.477098 --- ParallelTerminationStrategy: PID 23553 died... 16:38:59.495752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23553): Terminated: ok {rc=0} 16:38:59.538875 --- ParallelTerminationStrategy: PID 23556 died... 16:38:59.557204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23556): Terminated: ok {rc=0} 16:38:59.600022 --- ParallelTerminationStrategy: PID 23559 died... 16:38:59.618253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23559): Terminated: ok {rc=0} 16:38:59.702825 bus /sierra_3: Setting Powered False 16:39:00.800065 bus /sierra_3: Setting Powered False 16:39:01.943414 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:39:03.106740 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:39:03.119191 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:39:03.180522 tst mo_mt_call_osmux.py: using LAC 22344 16:39:03.306220 tst mo_mt_call_osmux.py: using RAC 159 16:39:03.432563 tst mo_mt_call_osmux.py: using CellId 22344 16:39:03.559727 tst mo_mt_call_osmux.py: using BVCI 22345 16:39:03.675697 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:39:03.687332 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:39:03.698815 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:39:03.710605 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:39:03.722347 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:39:03.734083 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:39:03.853486 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:39:03.969832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:04.432733 run create_hlr_db(pid=23562): Launched 16:39:04.555449 bus /sierra_2: Setting Powered False 16:39:05.614926 run create_hlr_db(pid=23562): Terminated: ok {rc=0} 16:39:06.052770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23564): Launched 16:39:06.374513 run osmo-hlr_10.42.42.2(pid=23565): Launched 16:39:06.496781 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:07.053019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23567): Launched 16:39:07.374792 run osmo-stp_10.42.42.5(pid=23568): Launched 16:39:07.498027 run osmo-msc_10.42.42.6: Starting osmo-msc 16:39:08.084257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23570): Launched 16:39:08.406342 run osmo-msc_10.42.42.6(pid=23571): Launched 16:39:08.585840 run osmo-stp_10.42.42.5(pid=23568): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23568)] 16:39:08.721722 run osmo-stp_10.42.42.5(pid=23568): stdout: | (launched: 2022-12-09_16:39:07.316129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:08.858902 run osmo-stp_10.42.42.5(pid=23568): stderr: | [0;m[38;5;43m20221209163907507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163907508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163907508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163907508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163907509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163907509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163907509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:08.995250 run osmo-stp_10.42.42.5(pid=23568): stdout: | (launched: 2022-12-09_16:39:07.316129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:09.123867 run osmo-stp_10.42.42.5(pid=23568): stderr: | [0;m[38;5;43m20221209163907507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163907508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163907508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163907508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163907509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163907509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163907509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:09.277759 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23568): Process ended prematurely: osmo-stp_10.42.42.5(pid=23568) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23568)] [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:39:09.287370 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:39:09.315452 run osmo-hlr_10.42.42.2(pid=23565): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23565)] 16:39:09.365155 run osmo-hlr_10.42.42.2(pid=23565): stdout: | (launched: 2022-12-09_16:39:06.316229) 16:39:09.416649 run osmo-hlr_10.42.42.2(pid=23565): stderr: | [0;m[1;31m20221209163906513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163906514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163906514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163906514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163906514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163906514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163906525 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163906534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163906534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163906534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:09.488359 run osmo-msc_10.42.42.6(pid=23571): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23571)] 16:39:09.537772 run osmo-msc_10.42.42.6(pid=23571): stdout: | (launched: 2022-12-09_16:39:08.347765) 16:39:09.589160 run osmo-msc_10.42.42.6(pid=23571): stderr: | [0;m[38;5;43m20221209163908670 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163908670 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f17a9643c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163908670 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163908670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163908670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163908671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163908672 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163908673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163908673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163908673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:39:09.640682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23564): Terminating (SIGTERM) 16:39:09.682491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23567): Terminating (SIGTERM) 16:39:09.724033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23570): Terminating (SIGTERM) 16:39:09.766049 --- ParallelTerminationStrategy: PID 23564 died... 16:39:09.785838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23564): Terminated: ok {rc=0} 16:39:09.831919 --- ParallelTerminationStrategy: PID 23567 died... 16:39:09.851349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23567): Terminated: ok {rc=0} 16:39:09.897371 --- ParallelTerminationStrategy: PID 23570 died... 16:39:09.916659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23570): Terminated: ok {rc=0} 16:39:10.003922 bus /sierra_3: Setting Powered False 16:39:11.102718 bus /sierra_3: Setting Powered False 16:39:12.219948 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:39:13.458677 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:39:13.465832 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:39:13.489494 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:39:13.516017 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:39:13.565307 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:39:13.588741 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:39:13.615039 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:39:14.172197 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:39:14.225877 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:14.237626 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:39:14.298314 tst mo_mt_call.py: using LAC 22345 16:39:14.423962 tst mo_mt_call.py: using RAC 160 16:39:14.547750 tst mo_mt_call.py: using CellId 22345 16:39:14.671432 tst mo_mt_call.py: using BVCI 22346 16:39:14.782121 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:14.793580 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:14.804665 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:14.815920 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:14.827260 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:14.838469 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:39:14.958183 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:39:15.074244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:15.536841 run create_hlr_db(pid=23576): Launched 16:39:15.659805 bus /sierra_2: Setting Powered False 16:39:16.725272 run create_hlr_db(pid=23576): Terminated: ok {rc=0} 16:39:17.183027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23578): Launched 16:39:17.486633 run osmo-hlr_10.42.42.2(pid=23579): Launched 16:39:17.601429 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:18.132765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23581): Launched 16:39:18.432348 run osmo-stp_10.42.42.5(pid=23582): Launched 16:39:18.545956 run osmo-msc_10.42.42.6: Starting osmo-msc 16:39:19.086842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23584): Launched 16:39:19.386637 run osmo-msc_10.42.42.6(pid=23585): Launched 16:39:19.553217 run osmo-stp_10.42.42.5(pid=23582): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23582)] 16:39:19.683370 run osmo-stp_10.42.42.5(pid=23582): stdout: | (launched: 2022-12-09_16:39:18.377233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:19.810431 run osmo-stp_10.42.42.5(pid=23582): stderr: | [0;m[38;5;43m20221209163918547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163918547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163918547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163918548 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163918548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163918548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163918548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:19.935602 run osmo-stp_10.42.42.5(pid=23582): stdout: | (launched: 2022-12-09_16:39:18.377233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:20.054443 run osmo-stp_10.42.42.5(pid=23582): stderr: | [0;m[38;5;43m20221209163918547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163918547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163918547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163918548 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163918548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163918548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163918548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:20.196765 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23582): Process ended prematurely: osmo-stp_10.42.42.5(pid=23582) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23582)] [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:39:20.205875 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 16:39:20.232120 run osmo-hlr_10.42.42.2(pid=23579): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23579)] 16:39:20.279360 run osmo-hlr_10.42.42.2(pid=23579): stdout: | (launched: 2022-12-09_16:39:17.430888) 16:39:20.328369 run osmo-hlr_10.42.42.2(pid=23579): stderr: | [0;m[1;31m20221209163917608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163917608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163917608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163917608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163917608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163917608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163917620 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163917630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163917630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163917630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:20.397000 run osmo-msc_10.42.42.6(pid=23585): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23585)] 16:39:20.443937 run osmo-msc_10.42.42.6(pid=23585): stdout: | (launched: 2022-12-09_16:39:19.331291) 16:39:20.492716 run osmo-msc_10.42.42.6(pid=23585): stderr: | [0;m[38;5;43m20221209163919605 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163919605 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f73898c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163919605 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163919605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163919605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163919606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163919607 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163919608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163919608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163919608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:39:20.541878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23578): Terminating (SIGTERM) 16:39:20.581158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23581): Terminating (SIGTERM) 16:39:20.620430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23584): Terminating (SIGTERM) 16:39:20.660221 --- ParallelTerminationStrategy: PID 23578 died... 16:39:20.679271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23578): Terminated: ok {rc=0} 16:39:20.722912 --- ParallelTerminationStrategy: PID 23581 died... 16:39:20.741509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23581): Terminated: ok {rc=0} 16:39:20.785049 --- ParallelTerminationStrategy: PID 23584 died... 16:39:20.803566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23584): Terminated: ok {rc=0} 16:39:20.888137 bus /sierra_3: Setting Powered False 16:39:21.989329 bus /sierra_3: Setting Powered False 16:39:23.104984 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:39:24.253408 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:24.265865 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:39:24.327008 tst mo_mt_call_osmux.py: using LAC 22346 16:39:24.453198 tst mo_mt_call_osmux.py: using RAC 161 16:39:24.571944 tst mo_mt_call_osmux.py: using CellId 22346 16:39:24.698807 tst mo_mt_call_osmux.py: using BVCI 22347 16:39:24.814741 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:24.826358 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:24.837914 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:24.849616 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:24.861406 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:39:24.872906 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:39:24.991933 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:39:25.108602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:25.573519 run create_hlr_db(pid=23587): Launched 16:39:25.696855 bus /sierra_2: Setting Powered False 16:39:26.756895 run create_hlr_db(pid=23587): Terminated: ok {rc=0} 16:39:27.196891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23589): Launched 16:39:27.519385 run osmo-hlr_10.42.42.2(pid=23590): Launched 16:39:27.643298 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:28.196173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23592): Launched 16:39:28.517319 run osmo-stp_10.42.42.5(pid=23593): Launched 16:39:28.640141 run osmo-msc_10.42.42.6: Starting osmo-msc 16:39:29.220864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23595): Launched 16:39:29.543039 run osmo-msc_10.42.42.6(pid=23596): Launched 16:39:29.721954 run osmo-stp_10.42.42.5(pid=23593): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23593)] 16:39:29.861807 run osmo-stp_10.42.42.5(pid=23593): stdout: | (launched: 2022-12-09_16:39:28.458895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:29.994014 run osmo-stp_10.42.42.5(pid=23593): stderr: | [0;m[38;5;43m20221209163928653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163928653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163928653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163928653 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163928654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163928654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163928654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:30.128776 run osmo-stp_10.42.42.5(pid=23593): stdout: | (launched: 2022-12-09_16:39:28.458895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:30.256752 run osmo-stp_10.42.42.5(pid=23593): stderr: | [0;m[38;5;43m20221209163928653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163928653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163928653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163928653 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163928654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163928654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163928654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:30.409823 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23593): Process ended prematurely: osmo-stp_10.42.42.5(pid=23593) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23593)] [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:39:30.419278 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:39:30.447229 run osmo-hlr_10.42.42.2(pid=23590): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23590)] 16:39:30.497418 run osmo-hlr_10.42.42.2(pid=23590): stdout: | (launched: 2022-12-09_16:39:27.460726) 16:39:30.549255 run osmo-hlr_10.42.42.2(pid=23590): stderr: | [0;m[1;31m20221209163927660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163927660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163927660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163927660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163927660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163927660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163927672 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163927682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163927683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163927683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:30.621241 run osmo-msc_10.42.42.6(pid=23596): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23596)] 16:39:30.670846 run osmo-msc_10.42.42.6(pid=23596): stdout: | (launched: 2022-12-09_16:39:29.484519) 16:39:30.722065 run osmo-msc_10.42.42.6(pid=23596): stderr: | [0;m[38;5;43m20221209163929805 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163929805 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4c19ff8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163929805 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163929806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163929806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163929806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163929807 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163929808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163929808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163929808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:39:30.773717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23589): Terminating (SIGTERM) 16:39:30.815169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23592): Terminating (SIGTERM) 16:39:30.859384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23595): Terminating (SIGTERM) 16:39:30.910328 --- ParallelTerminationStrategy: PID 23589 died... 16:39:30.934988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23589): Terminated: ok {rc=0} 16:39:30.984061 --- ParallelTerminationStrategy: PID 23592 died... 16:39:31.003540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23592): Terminated: ok {rc=0} 16:39:31.052431 --- ParallelTerminationStrategy: PID 23595 died... 16:39:31.072232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23595): Terminated: ok {rc=0} 16:39:31.159193 bus /sierra_3: Setting Powered False 16:39:32.263711 bus /sierra_3: Setting Powered False 16:39:33.378514 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:39:34.618265 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:39:34.626866 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:39:34.650343 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:39:34.676663 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:39:34.728080 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:39:34.751608 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:39:34.778595 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:39:35.330820 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:39:35.378639 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:35.390077 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:39:35.452370 tst mo_mt_call.py: using LAC 22347 16:39:35.570682 tst mo_mt_call.py: using RAC 162 16:39:35.691521 tst mo_mt_call.py: using CellId 22347 16:39:35.808668 tst mo_mt_call.py: using BVCI 22348 16:39:35.916089 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:35.927275 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:35.938339 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:35.949463 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:35.960456 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:35.971438 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:39:36.090022 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:39:36.206247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:36.669727 run create_hlr_db(pid=23601): Launched 16:39:36.791287 bus /sierra_2: Setting Powered False 16:39:37.851055 run create_hlr_db(pid=23601): Terminated: ok {rc=0} 16:39:38.288678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23603): Launched 16:39:38.609901 run osmo-hlr_10.42.42.2(pid=23604): Launched 16:39:38.731826 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:39.287255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23606): Launched 16:39:39.608359 run osmo-stp_10.42.42.5(pid=23607): Launched 16:39:39.731175 run osmo-msc_10.42.42.6: Starting osmo-msc 16:39:40.314286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23609): Launched 16:39:40.635411 run osmo-msc_10.42.42.6(pid=23610): Launched 16:39:40.814289 run osmo-stp_10.42.42.5(pid=23607): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23607)] 16:39:40.949524 run osmo-stp_10.42.42.5(pid=23607): stdout: | (launched: 2022-12-09_16:39:39.550024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:41.085878 run osmo-stp_10.42.42.5(pid=23607): stderr: | [0;m[38;5;43m20221209163939742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163939742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163939742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163939743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163939743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163939743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163939743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:41.221456 run osmo-stp_10.42.42.5(pid=23607): stdout: | (launched: 2022-12-09_16:39:39.550024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:41.348700 run osmo-stp_10.42.42.5(pid=23607): stderr: | [0;m[38;5;43m20221209163939742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163939742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163939742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163939743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163939743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163939743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163939743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:41.501197 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23607): Process ended prematurely: osmo-stp_10.42.42.5(pid=23607) [trial-2361↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23607)] [trial-2361↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:39:41.510841 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:39:41.539012 run osmo-hlr_10.42.42.2(pid=23604): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23604)] 16:39:41.588768 run osmo-hlr_10.42.42.2(pid=23604): stdout: | (launched: 2022-12-09_16:39:38.551148) 16:39:41.640309 run osmo-hlr_10.42.42.2(pid=23604): stderr: | [0;m[1;31m20221209163938748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163938748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163938748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163938748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163938749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163938749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163938761 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163938770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163938770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163938770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:41.712498 run osmo-msc_10.42.42.6(pid=23610): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23610)] 16:39:41.762293 run osmo-msc_10.42.42.6(pid=23610): stdout: | (launched: 2022-12-09_16:39:40.576636) 16:39:41.813708 run osmo-msc_10.42.42.6(pid=23610): stderr: | [0;m[38;5;43m20221209163940897 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163940897 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbba5814c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163940897 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163940897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163940898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163940898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163940899 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163940900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163940900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163940900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:39:41.865583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23603): Terminating (SIGTERM) 16:39:41.907402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23606): Terminating (SIGTERM) 16:39:41.948883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23609): Terminating (SIGTERM) 16:39:41.990794 --- ParallelTerminationStrategy: PID 23603 died... 16:39:42.010564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23603): Terminated: ok {rc=0} 16:39:42.057346 --- ParallelTerminationStrategy: PID 23606 died... 16:39:42.076657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23606): Terminated: ok {rc=0} 16:39:42.122757 --- ParallelTerminationStrategy: PID 23609 died... 16:39:42.142056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23609): Terminated: ok {rc=0} 16:39:42.229875 bus /sierra_3: Setting Powered False 16:39:43.328109 bus /sierra_3: Setting Powered False 16:39:44.442840 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:39:45.585229 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:45.597383 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:39:45.657464 tst mo_mt_call_osmux.py: using LAC 22348 16:39:45.775954 tst mo_mt_call_osmux.py: using RAC 163 16:39:45.902909 tst mo_mt_call_osmux.py: using CellId 22348 16:39:46.040056 tst mo_mt_call_osmux.py: using BVCI 22349 16:39:46.166319 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:46.178679 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:46.190926 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:46.203782 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:46.217914 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:39:46.232011 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:39:46.358153 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:39:46.511375 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:46.986691 run create_hlr_db(pid=23612): Launched 16:39:47.146069 bus /sierra_2: Setting Powered False 16:39:48.206250 run create_hlr_db(pid=23612): Terminated: ok {rc=0} 16:39:48.644354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23614): Launched 16:39:48.966492 run osmo-hlr_10.42.42.2(pid=23615): Launched 16:39:49.088849 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:49.644723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23617): Launched 16:39:49.966646 run osmo-stp_10.42.42.5(pid=23618): Launched 16:39:50.089563 run osmo-msc_10.42.42.6: Starting osmo-msc 16:39:50.670966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23620): Launched 16:39:50.993840 run osmo-msc_10.42.42.6(pid=23621): Launched 16:39:51.174797 run osmo-stp_10.42.42.5(pid=23618): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23618)] 16:39:51.310815 run osmo-stp_10.42.42.5(pid=23618): stdout: | (launched: 2022-12-09_16:39:49.907900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:51.447440 run osmo-stp_10.42.42.5(pid=23618): stderr: | [0;m[38;5;43m20221209163950100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163950100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163950100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163950101 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163950101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163950101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163950101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:51.583530 run osmo-stp_10.42.42.5(pid=23618): stdout: | (launched: 2022-12-09_16:39:49.907900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:51.711194 run osmo-stp_10.42.42.5(pid=23618): stderr: | [0;m[38;5;43m20221209163950100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209163950100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209163950100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209163950101 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209163950101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209163950101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209163950101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:51.864287 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23618): Process ended prematurely: osmo-stp_10.42.42.5(pid=23618) [trial-2361↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23618)] [trial-2361↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:39:51.873706 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:39:51.901711 run osmo-hlr_10.42.42.2(pid=23615): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23615)] 16:39:51.951248 run osmo-hlr_10.42.42.2(pid=23615): stdout: | (launched: 2022-12-09_16:39:48.908197) 16:39:52.002754 run osmo-hlr_10.42.42.2(pid=23615): stderr: | [0;m[1;31m20221209163949105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209163949105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209163949105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209163949105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209163949105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209163949106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209163949118 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209163949126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209163949126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209163949127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:52.074230 run osmo-msc_10.42.42.6(pid=23621): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23621)] 16:39:52.123771 run osmo-msc_10.42.42.6(pid=23621): stdout: | (launched: 2022-12-09_16:39:50.935097) 16:39:52.174708 run osmo-msc_10.42.42.6(pid=23621): stderr: | [0;m[38;5;43m20221209163951257 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209163951257 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fee0d304c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209163951257 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209163951257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209163951257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209163951258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209163951259 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209163951260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209163951260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209163951260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:39:52.226221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23614): Terminating (SIGTERM) 16:39:52.267614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23617): Terminating (SIGTERM) 16:39:52.309072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23620): Terminating (SIGTERM) 16:39:52.351214 --- ParallelTerminationStrategy: PID 23614 died... 16:39:52.371343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23614): Terminated: ok {rc=0} 16:39:52.417323 --- ParallelTerminationStrategy: PID 23617 died... 16:39:52.436473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23617): Terminated: ok {rc=0} 16:39:52.482403 --- ParallelTerminationStrategy: PID 23620 died... 16:39:52.501683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23620): Terminated: ok {rc=0} 16:39:52.589230 bus /sierra_3: Setting Powered False 16:39:53.686632 bus /sierra_3: Setting Powered False 16:39:54.802645 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 emergency:nanobts+band-1900 --------------------------------------------------------------------- 16:39:56.046242 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:39:56.052491 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 16:39:56.077236 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 16:39:56.103775 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 16:39:56.187341 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 16:39:56.210829 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 16:39:56.237076 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 16:39:56.826563 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2361 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 16:39:56.832616 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:56.843481 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:39:56.885105 tst emergency_mo_mt_call.py: using LAC 22349 16:39:56.999672 tst emergency_mo_mt_call.py: using RAC 164 16:39:57.113067 tst emergency_mo_mt_call.py: using CellId 22349 16:39:57.225389 tst emergency_mo_mt_call.py: using BVCI 22350 16:39:57.331561 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:57.342269 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:57.352831 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:57.363397 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:57.373928 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:39:57.384358 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:39:57.502257 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:39:57.619985 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:58.109254 run create_hlr_db(pid=23626): Launched 16:39:58.228936 bus /sierra_2: Setting Powered False 16:39:59.291817 run create_hlr_db(pid=23626): Terminated: ok {rc=0} 16:39:59.713908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23628): Launched 16:40:00.008374 run osmo-hlr_10.42.42.2(pid=23629): Launched 16:40:00.119765 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:00.625016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23631): Launched 16:40:00.937677 run osmo-stp_10.42.42.5(pid=23632): Launched 16:40:01.202164 tst emergency_mo_mt_call.py: using MSISDN 7271 16:40:01.410528 run osmo-msc_10.42.42.6: Starting osmo-msc 16:40:02.016200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23636): Launched 16:40:02.349074 run osmo-msc_10.42.42.6(pid=23638): Launched 16:40:02.528669 run osmo-stp_10.42.42.5(pid=23632): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23632)] 16:40:02.666368 run osmo-stp_10.42.42.5(pid=23632): stdout: | (launched: 2022-12-09_16:40:00.866335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:02.801684 run osmo-stp_10.42.42.5(pid=23632): stderr: | [0;m[38;5;43m20221209164001105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164001105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164001105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164001105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164001106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164001106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164001106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:02.935825 run osmo-stp_10.42.42.5(pid=23632): stdout: | (launched: 2022-12-09_16:40:00.866335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:03.062404 run osmo-stp_10.42.42.5(pid=23632): stderr: | [0;m[38;5;43m20221209164001105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164001105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164001105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164001105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164001106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164001106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164001106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:03.213071 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23632): Process ended prematurely: osmo-stp_10.42.42.5(pid=23632) [trial-2361↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23632)] [trial-2361↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 16:40:03.222263 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 16:40:03.249895 run osmo-hlr_10.42.42.2(pid=23629): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23629)] 16:40:03.299804 run osmo-hlr_10.42.42.2(pid=23629): stdout: | (launched: 2022-12-09_16:39:59.954225) 16:40:03.351275 run osmo-hlr_10.42.42.2(pid=23629): stderr: | [0;m[1;31m20221209164000132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164000132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164000132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164000132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164000132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164000132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164000144 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164000153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164000153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164000153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:03.423420 run osmo-msc_10.42.42.6(pid=23638): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23638)] 16:40:03.473565 run osmo-msc_10.42.42.6(pid=23638): stdout: | (launched: 2022-12-09_16:40:02.291315) 16:40:03.524886 run osmo-msc_10.42.42.6(pid=23638): stderr: | [0;m[38;5;43m20221209164002606 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164002606 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f50a472ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164002606 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164002606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164002606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164002607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164002608 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164002609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164002609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164002609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:40:03.576654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23628): Terminating (SIGTERM) 16:40:03.618499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23631): Terminating (SIGTERM) 16:40:03.660074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23636): Terminating (SIGTERM) 16:40:03.702091 --- ParallelTerminationStrategy: PID 23628 died... 16:40:03.721957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23628): Terminated: ok {rc=0} 16:40:03.768336 --- ParallelTerminationStrategy: PID 23631 died... 16:40:03.787882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23631): Terminated: ok {rc=0} 16:40:03.833936 --- ParallelTerminationStrategy: PID 23636 died... 16:40:03.853388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23636): Terminated: ok {rc=0} 16:40:03.941994 bus /sierra_3: Setting Powered False 16:40:05.037909 bus /sierra_3: Setting Powered False 16:40:06.153094 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 16:40:07.240783 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:40:07.252363 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:40:07.293607 tst emergency_preemptive_call.py: using LAC 22350 16:40:07.410380 tst emergency_preemptive_call.py: using RAC 165 16:40:07.526919 tst emergency_preemptive_call.py: using CellId 22350 16:40:07.641599 tst emergency_preemptive_call.py: using BVCI 22351 16:40:07.747775 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:40:07.758780 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:40:07.769647 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:40:07.780392 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:40:07.791177 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 16:40:07.801977 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:07.919066 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:08.037232 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:08.156001 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:08.270332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:08.725512 run create_hlr_db(pid=23640): Launched 16:40:08.845225 bus /sierra_2: Setting Powered False 16:40:09.904639 run create_hlr_db(pid=23640): Terminated: ok {rc=0} 16:40:10.336132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23642): Launched 16:40:10.651781 run osmo-hlr_10.42.42.2(pid=23643): Launched 16:40:10.772109 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:11.287305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23645): Launched 16:40:11.582006 run osmo-stp_10.42.42.5(pid=23646): Launched 16:40:11.704770 tst emergency_preemptive_call.py: using MSISDN 7272 16:40:11.859992 run osmo-msc_10.42.42.6: Starting osmo-msc 16:40:12.388316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23648): Launched 16:40:12.683853 run osmo-msc_10.42.42.6(pid=23649): Launched 16:40:12.848896 run osmo-stp_10.42.42.5(pid=23646): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23646)] 16:40:12.974055 run osmo-stp_10.42.42.5(pid=23646): stdout: | (launched: 2022-12-09_16:40:11.527688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:13.098971 run osmo-stp_10.42.42.5(pid=23646): stderr: | [0;m[38;5;43m20221209164011698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164011698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164011699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164011699 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164011699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164011699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164011700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:13.221604 run osmo-stp_10.42.42.5(pid=23646): stdout: | (launched: 2022-12-09_16:40:11.527688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:13.339703 run osmo-stp_10.42.42.5(pid=23646): stderr: | [0;m[38;5;43m20221209164011698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164011698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164011699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164011699 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164011699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164011699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164011700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:13.481382 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23646): Process ended prematurely: osmo-stp_10.42.42.5(pid=23646) [trial-2361↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23646)] [trial-2361↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 16:40:13.489623 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 16:40:13.515763 run osmo-hlr_10.42.42.2(pid=23643): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23643)] 16:40:13.562960 run osmo-hlr_10.42.42.2(pid=23643): stdout: | (launched: 2022-12-09_16:40:10.594175) 16:40:13.611869 run osmo-hlr_10.42.42.2(pid=23643): stderr: | [0;m[1;31m20221209164010791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164010791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164010791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164010791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164010791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164010791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164010808 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164010817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164010818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164010818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:13.680466 run osmo-msc_10.42.42.6(pid=23649): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23649)] 16:40:13.727444 run osmo-msc_10.42.42.6(pid=23649): stdout: | (launched: 2022-12-09_16:40:12.629276) 16:40:13.776195 run osmo-msc_10.42.42.6(pid=23649): stderr: | [0;m[38;5;43m20221209164012899 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164012899 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f19db757c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164012899 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164012899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164012899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164012899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164012901 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164012902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164012902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164012902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:40:13.825550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23642): Terminating (SIGTERM) 16:40:13.865067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23645): Terminating (SIGTERM) 16:40:13.904623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23648): Terminating (SIGTERM) 16:40:13.944350 --- ParallelTerminationStrategy: PID 23642 died... 16:40:13.963101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23642): Terminated: ok {rc=0} 16:40:14.006766 --- ParallelTerminationStrategy: PID 23645 died... 16:40:14.025445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23645): Terminated: ok {rc=0} 16:40:14.068937 --- ParallelTerminationStrategy: PID 23648 died... 16:40:14.087583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23648): Terminated: ok {rc=0} 16:40:14.172473 bus /sierra_9: Setting Powered False 16:40:15.270795 bus /sierra_9: Setting Powered False 16:40:16.407437 bus /sierra_8: Setting Powered False 16:40:17.518024 bus /sierra_8: Setting Powered False 16:40:18.634092 bus /sierra_3: Setting Powered False 16:40:19.731368 bus /sierra_3: Setting Powered False 16:40:20.846785 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:nanobts+band-1900 --------------------------------------------------------------------- 16:40:22.113616 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:40:22.119761 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 16:40:22.144144 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 16:40:22.184496 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 16:40:22.272728 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 16:40:22.296740 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 16:40:22.336051 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 16:40:22.929593 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 16:40:22.982408 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:22.993633 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:40:23.033381 tst cs_paging_gprs_active.py: using LAC 22351 16:40:23.160404 tst cs_paging_gprs_active.py: using RAC 166 16:40:23.284843 tst cs_paging_gprs_active.py: using CellId 22351 16:40:23.410329 tst cs_paging_gprs_active.py: using BVCI 22352 16:40:23.526836 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:23.538090 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:23.548938 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:23.560135 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:23.571312 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:23.582513 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:23.593882 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:23.604796 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:23.616076 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:23.737915 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:23.855972 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:40:24.074417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:24.397851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23655): Launched 16:40:24.678022 run iperf3-srv_10.42.42.10(pid=23656): Launched 16:40:24.798509 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:40:25.015531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:25.339356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23657): Launched 16:40:25.620284 run iperf3-srv_10.42.42.10(pid=23658): Launched 16:40:25.741202 tst cs_paging_gprs_active.py:38: start network... 16:40:25.958133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:26.456295 run create_hlr_db(pid=23659): Launched 16:40:26.578662 bus /sierra_2: Setting Powered False 16:40:27.642276 run create_hlr_db(pid=23659): Terminated: ok {rc=0} 16:40:28.072289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23661): Launched 16:40:28.374478 run osmo-hlr_10.42.42.2(pid=23662): Launched 16:40:28.488673 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:29.004603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23664): Launched 16:40:29.307248 run osmo-stp_10.42.42.5(pid=23665): Launched 16:40:29.421890 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:40:29.939445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23667): Launched 16:40:30.054598 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:40:30.310090 run patchelf(pid=23668): Launched 16:40:30.478383 run osmo-stp_10.42.42.5(pid=23665): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23665)] 16:40:30.606011 run osmo-stp_10.42.42.5(pid=23665): stdout: | (launched: 2022-12-09_16:40:29.251673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:30.735992 run osmo-stp_10.42.42.5(pid=23665): stderr: | [0;m[38;5;43m20221209164029419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164029419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164029420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164029420 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164029421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164029421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164029421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:30.878082 run osmo-stp_10.42.42.5(pid=23665): stdout: | (launched: 2022-12-09_16:40:29.251673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:31.033731 run osmo-stp_10.42.42.5(pid=23665): stderr: | [0;m[38;5;43m20221209164029419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164029419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164029420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164029420 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164029421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164029421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164029421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:31.182379 run patchelf(pid=23668): Terminating (SIGINT) 16:40:31.359072 run patchelf(pid=23668): Terminated: ok {rc=0} 16:40:31.490553 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23665): Process ended prematurely: osmo-stp_10.42.42.5(pid=23665) [trial-2361↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23665)] [trial-2361↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 16:40:31.506972 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 16:40:31.543511 run osmo-hlr_10.42.42.2(pid=23662): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23662)] 16:40:31.592743 run osmo-hlr_10.42.42.2(pid=23662): stdout: | (launched: 2022-12-09_16:40:28.319174) 16:40:31.643397 run osmo-hlr_10.42.42.2(pid=23662): stderr: | [0;m[1;31m20221209164028494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164028494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164028494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164028494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164028495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164028495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164028512 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164028521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164028521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164028521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:31.695080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23655): Terminating (SIGTERM) 16:40:31.737663 run iperf3-srv_10.42.42.10(pid=23656): Terminating (SIGTERM) 16:40:31.782425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23657): Terminating (SIGTERM) 16:40:31.824797 run iperf3-srv_10.42.42.10(pid=23658): Terminating (SIGTERM) 16:40:31.869817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23661): Terminating (SIGTERM) 16:40:31.912423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23664): Terminating (SIGTERM) 16:40:31.954102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23667): Terminating (SIGTERM) 16:40:31.996309 --- ParallelTerminationStrategy: PID 23655 died... 16:40:32.016051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23655): Terminated: ok {rc=0} 16:40:32.062407 --- ParallelTerminationStrategy: PID 23656 died... 16:40:32.082092 run iperf3-srv_10.42.42.10(pid=23656): Terminated {rc=256} 16:40:32.128196 --- ParallelTerminationStrategy: PID 23657 died... 16:40:32.147802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23657): Terminated: ok {rc=0} 16:40:32.193881 --- ParallelTerminationStrategy: PID 23658 died... 16:40:32.213287 run iperf3-srv_10.42.42.10(pid=23658): Terminated {rc=256} 16:40:32.259531 --- ParallelTerminationStrategy: PID 23661 died... 16:40:32.279301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23661): Terminated: ok {rc=0} 16:40:32.322883 --- ParallelTerminationStrategy: PID 23664 died... 16:40:32.341508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23664): Terminated: ok {rc=0} 16:40:32.384802 --- ParallelTerminationStrategy: PID 23667 died... 16:40:32.403647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23667): Terminated: ok {rc=0} 16:40:32.488425 bus /gobi_0: Setting Powered False 16:40:33.587732 bus /gobi_0: Setting Powered False 16:40:34.701575 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 16:40:35.845709 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:35.857275 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:40:35.895543 tst iperf3.py: using LAC 22352 16:40:36.022307 tst iperf3.py: using RAC 167 16:40:36.148389 tst iperf3.py: using CellId 22352 16:40:36.273565 tst iperf3.py: using BVCI 22353 16:40:36.392086 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:36.403421 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:36.414628 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:36.425809 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:36.436808 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:36.448035 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:36.459557 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:36.470752 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:36.482066 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:36.600741 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:40:36.802946 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:37.104552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23669): Launched 16:40:37.366136 run iperf3-srv_10.42.42.10(pid=23670): Launched 16:40:37.478319 tst iperf3.py:8: start network... 16:40:37.680345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:38.142965 run create_hlr_db(pid=23671): Launched 16:40:38.266482 bus /gobi_6: Setting Powered False 16:40:39.326468 run create_hlr_db(pid=23671): Terminated: ok {rc=0} 16:40:39.765641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23673): Launched 16:40:40.088191 run osmo-hlr_10.42.42.2(pid=23674): Launched 16:40:40.211294 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:40.764512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23676): Launched 16:40:41.085130 run osmo-stp_10.42.42.5(pid=23677): Launched 16:40:41.207601 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:40:41.763619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23679): Launched 16:40:41.887483 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:40:42.161295 run patchelf(pid=23680): Launched 16:40:42.340540 run osmo-stp_10.42.42.5(pid=23677): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23677)] 16:40:42.476685 run osmo-stp_10.42.42.5(pid=23677): stdout: | (launched: 2022-12-09_16:40:41.026227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:42.614418 run osmo-stp_10.42.42.5(pid=23677): stderr: | [0;m[38;5;43m20221209164041217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164041217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164041218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164041218 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164041218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164041219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164041219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:42.752287 run osmo-stp_10.42.42.5(pid=23677): stdout: | (launched: 2022-12-09_16:40:41.026227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:42.883603 run osmo-stp_10.42.42.5(pid=23677): stderr: | [0;m[38;5;43m20221209164041217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164041217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164041218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164041218 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164041218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164041219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164041219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:43.039624 run patchelf(pid=23680): Terminating (SIGINT) 16:40:43.220064 run patchelf(pid=23680): Terminated: ok {rc=0} 16:40:43.350458 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23677): Process ended prematurely: osmo-stp_10.42.42.5(pid=23677) [trial-2361↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23677)] [trial-2361↪gprs:nanobts+band-1900↪iperf3.py:8] 16:40:43.360472 tst iperf3.py:8: Test FAILED (7.5 sec) 16:40:43.389391 run osmo-hlr_10.42.42.2(pid=23674): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23674)] 16:40:43.439317 run osmo-hlr_10.42.42.2(pid=23674): stdout: | (launched: 2022-12-09_16:40:40.028708) 16:40:43.490750 run osmo-hlr_10.42.42.2(pid=23674): stderr: | [0;m[1;31m20221209164040226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164040226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164040226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164040226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164040226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164040226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164040238 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164040247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164040247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164040247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:43.542594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23669): Terminating (SIGTERM) 16:40:43.584121 run iperf3-srv_10.42.42.10(pid=23670): Terminating (SIGTERM) 16:40:43.625412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23673): Terminating (SIGTERM) 16:40:43.666941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23676): Terminating (SIGTERM) 16:40:43.708164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23679): Terminating (SIGTERM) 16:40:43.749636 --- ParallelTerminationStrategy: PID 23669 died... 16:40:43.769550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23669): Terminated: ok {rc=0} 16:40:43.815840 --- ParallelTerminationStrategy: PID 23670 died... 16:40:43.835224 run iperf3-srv_10.42.42.10(pid=23670): Terminated {rc=256} 16:40:43.881115 --- ParallelTerminationStrategy: PID 23673 died... 16:40:43.900437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23673): Terminated: ok {rc=0} 16:40:43.946757 --- ParallelTerminationStrategy: PID 23676 died... 16:40:43.966389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23676): Terminated: ok {rc=0} 16:40:44.012412 --- ParallelTerminationStrategy: PID 23679 died... 16:40:44.031717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23679): Terminated: ok {rc=0} 16:40:44.119177 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 16:40:45.268533 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:45.280661 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:40:45.332850 tst iperf3m4.py: using LAC 22353 16:40:45.462252 tst iperf3m4.py: using RAC 168 16:40:45.588091 tst iperf3m4.py: using CellId 22353 16:40:45.714575 tst iperf3m4.py: using BVCI 22354 16:40:45.823477 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:45.834314 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:45.845585 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:45.856393 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:45.867458 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:45.878577 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:45.889875 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:45.900937 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:40:45.913173 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:46.059761 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:46.194891 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:46.336430 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:40:46.454290 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:40:46.667451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:46.982047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23681): Launched 16:40:47.270721 run iperf3-srv_10.42.42.10(pid=23682): Launched 16:40:47.388557 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:40:47.606594 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:47.931196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23683): Launched 16:40:48.212879 run iperf3-srv_10.42.42.10(pid=23684): Launched 16:40:48.334342 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:40:48.552448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:48.877218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23685): Launched 16:40:49.159563 run iperf3-srv_10.42.42.10(pid=23686): Launched 16:40:49.280709 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:40:49.498814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:49.823967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23687): Launched 16:40:50.105992 run iperf3-srv_10.42.42.10(pid=23688): Launched 16:40:50.226826 tst iperf3m4.py:8: start network... 16:40:50.444778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:50.942544 run create_hlr_db(pid=23689): Launched 16:40:51.065634 bus /gobi_6: Setting Powered False 16:40:52.130015 run create_hlr_db(pid=23689): Terminated: ok {rc=0} 16:40:52.559411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23691): Launched 16:40:52.860789 run osmo-hlr_10.42.42.2(pid=23692): Launched 16:40:52.975437 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:53.491451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23694): Launched 16:40:53.792460 run osmo-stp_10.42.42.5(pid=23695): Launched 16:40:53.906981 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:40:54.423931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23697): Launched 16:40:54.539017 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:40:54.793160 run patchelf(pid=23698): Launched 16:40:54.962984 run osmo-stp_10.42.42.5(pid=23695): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23695)] 16:40:55.090663 run osmo-stp_10.42.42.5(pid=23695): stdout: | (launched: 2022-12-09_16:40:53.737230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:55.219649 run osmo-stp_10.42.42.5(pid=23695): stderr: | [0;m[38;5;43m20221209164053905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164053905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164053906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164053906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164053906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164053907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164053907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:55.348395 run osmo-stp_10.42.42.5(pid=23695): stdout: | (launched: 2022-12-09_16:40:53.737230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:55.471152 run osmo-stp_10.42.42.5(pid=23695): stderr: | [0;m[38;5;43m20221209164053905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164053905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164053906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164053906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164053906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164053907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164053907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:55.616710 run patchelf(pid=23698): Terminating (SIGINT) 16:40:55.786281 run patchelf(pid=23698): Terminated: ok {rc=0} 16:40:55.907787 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23695): Process ended prematurely: osmo-stp_10.42.42.5(pid=23695) [trial-2361↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23695)] [trial-2361↪gprs:nanobts+band-1900↪iperf3m4.py:8] 16:40:55.917287 tst iperf3m4.py:8: Test FAILED (10.7 sec) 16:40:55.944282 run osmo-hlr_10.42.42.2(pid=23692): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23692)] 16:40:55.991298 run osmo-hlr_10.42.42.2(pid=23692): stdout: | (launched: 2022-12-09_16:40:52.805645) 16:40:56.039960 run osmo-hlr_10.42.42.2(pid=23692): stderr: | [0;m[1;31m20221209164052978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164052978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164052978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164052978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164052979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164052979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164052991 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164053002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164053002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164053002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:56.089036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23681): Terminating (SIGTERM) 16:40:56.128251 run iperf3-srv_10.42.42.10(pid=23682): Terminating (SIGTERM) 16:40:56.167310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23683): Terminating (SIGTERM) 16:40:56.206294 run iperf3-srv_10.42.42.10(pid=23684): Terminating (SIGTERM) 16:40:56.245249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23685): Terminating (SIGTERM) 16:40:56.284349 run iperf3-srv_10.42.42.10(pid=23686): Terminating (SIGTERM) 16:40:56.323234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23687): Terminating (SIGTERM) 16:40:56.362231 run iperf3-srv_10.42.42.10(pid=23688): Terminating (SIGTERM) 16:40:56.401092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23691): Terminating (SIGTERM) 16:40:56.440081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23694): Terminating (SIGTERM) 16:40:56.478922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23697): Terminating (SIGTERM) 16:40:56.518250 --- ParallelTerminationStrategy: PID 23681 died... 16:40:56.537250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23681): Terminated: ok {rc=0} 16:40:56.580765 --- ParallelTerminationStrategy: PID 23682 died... 16:40:56.599186 run iperf3-srv_10.42.42.10(pid=23682): Terminated {rc=256} 16:40:56.642310 --- ParallelTerminationStrategy: PID 23683 died... 16:40:56.660709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23683): Terminated: ok {rc=0} 16:40:56.703861 --- ParallelTerminationStrategy: PID 23684 died... 16:40:56.722212 run iperf3-srv_10.42.42.10(pid=23684): Terminated {rc=256} 16:40:56.765287 --- ParallelTerminationStrategy: PID 23685 died... 16:40:56.783638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23685): Terminated: ok {rc=0} 16:40:56.826866 --- ParallelTerminationStrategy: PID 23686 died... 16:40:56.845249 run iperf3-srv_10.42.42.10(pid=23686): Terminated {rc=256} 16:40:56.889288 --- ParallelTerminationStrategy: PID 23687 died... 16:40:56.907593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23687): Terminated: ok {rc=0} 16:40:56.951131 --- ParallelTerminationStrategy: PID 23688 died... 16:40:56.969612 run iperf3-srv_10.42.42.10(pid=23688): Terminated {rc=256} 16:40:57.013461 --- ParallelTerminationStrategy: PID 23691 died... 16:40:57.031905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23691): Terminated: ok {rc=0} 16:40:57.075280 --- ParallelTerminationStrategy: PID 23694 died... 16:40:57.093834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23694): Terminated: ok {rc=0} 16:40:57.137181 --- ParallelTerminationStrategy: PID 23697 died... 16:40:57.155546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23697): Terminated: ok {rc=0} 16:40:57.240713 bus /gobi_4: Setting Powered False 16:40:58.339925 bus /gobi_4: Setting Powered False 16:40:59.453390 bus /gobi_1: Setting Powered False 16:41:00.551310 bus /gobi_1: Setting Powered False 16:41:01.661171 bus /gobi_0: Setting Powered False 16:41:02.757784 bus /gobi_0: Setting Powered False 16:41:03.871539 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 16:41:04.972662 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:04.984087 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:41:05.023420 tst ping.py: using LAC 22354 16:41:05.141476 tst ping.py: using RAC 169 16:41:05.257140 tst ping.py: using CellId 22354 16:41:05.375721 tst ping.py: using BVCI 22355 16:41:05.483063 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:05.493802 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:05.504303 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:05.514842 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:05.525211 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:05.535584 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:05.546170 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:05.556568 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:41:05.676473 tst ping.py:19: start network... 16:41:05.876219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:06.332548 run create_hlr_db(pid=23699): Launched 16:41:06.452216 bus /gobi_6: Setting Powered False 16:41:07.511535 run create_hlr_db(pid=23699): Terminated: ok {rc=0} 16:41:07.944835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23701): Launched 16:41:08.260603 run osmo-hlr_10.42.42.2(pid=23702): Launched 16:41:08.381558 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:08.930264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23704): Launched 16:41:09.247904 run osmo-stp_10.42.42.5(pid=23705): Launched 16:41:09.369007 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:41:09.914261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23707): Launched 16:41:10.035955 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:41:10.304383 run patchelf(pid=23708): Launched 16:41:10.480942 run osmo-stp_10.42.42.5(pid=23705): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23705)] 16:41:10.615194 run osmo-stp_10.42.42.5(pid=23705): stdout: | (launched: 2022-12-09_16:41:09.190000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:10.751604 run osmo-stp_10.42.42.5(pid=23705): stderr: | [0;m[38;5;43m20221209164109378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164109378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164109378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164109378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164109379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164109379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164109379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:10.887800 run osmo-stp_10.42.42.5(pid=23705): stdout: | (launched: 2022-12-09_16:41:09.190000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:11.018095 run osmo-stp_10.42.42.5(pid=23705): stderr: | [0;m[38;5;43m20221209164109378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164109378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164109378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164109378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164109379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164109379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164109379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:11.172772 run patchelf(pid=23708): Terminating (SIGINT) 16:41:11.350331 run patchelf(pid=23708): Terminated: ok {rc=0} 16:41:11.477802 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23705): Process ended prematurely: osmo-stp_10.42.42.5(pid=23705) [trial-2361↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23705)] [trial-2361↪gprs:nanobts+band-1900↪ping.py:22] 16:41:11.487617 tst ping.py:22: Test FAILED (6.5 sec) 16:41:11.515979 run osmo-hlr_10.42.42.2(pid=23702): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23702)] 16:41:11.565715 run osmo-hlr_10.42.42.2(pid=23702): stdout: | (launched: 2022-12-09_16:41:08.203035) 16:41:11.617102 run osmo-hlr_10.42.42.2(pid=23702): stderr: | [0;m[1;31m20221209164108399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164108399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164108399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164108399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164108399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164108399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164108416 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164108426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164108426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164108426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:11.668723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23701): Terminating (SIGTERM) 16:41:11.710444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23704): Terminating (SIGTERM) 16:41:11.752190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23707): Terminating (SIGTERM) 16:41:11.794476 --- ParallelTerminationStrategy: PID 23701 died... 16:41:11.814432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23701): Terminated: ok {rc=0} 16:41:11.861384 --- ParallelTerminationStrategy: PID 23704 died... 16:41:11.880875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23704): Terminated: ok {rc=0} 16:41:11.927585 --- ParallelTerminationStrategy: PID 23707 died... 16:41:11.947041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23707): Terminated: ok {rc=0} 16:41:12.033910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 16:41:13.120280 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:13.132937 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 16:41:13.179112 tst ping_idle_ping.py: using LAC 22355 16:41:13.304101 tst ping_idle_ping.py: using RAC 170 16:41:13.426536 tst ping_idle_ping.py: using CellId 22355 16:41:13.549821 tst ping_idle_ping.py: using BVCI 22356 16:41:13.658834 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:13.669639 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:13.680110 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:13.690882 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:13.701329 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:13.711596 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:13.722286 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 16:41:13.732898 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 16:41:13.847002 tst ping_idle_ping.py:24: start network... 16:41:14.045930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:14.504849 run create_hlr_db(pid=23709): Launched 16:41:14.626711 bus /gobi_6: Setting Powered False 16:41:15.686667 run create_hlr_db(pid=23709): Terminated: ok {rc=0} 16:41:16.129654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23711): Launched 16:41:16.437430 run osmo-hlr_10.42.42.2(pid=23712): Launched 16:41:16.569459 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:17.262073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23714): Launched 16:41:17.592659 run osmo-stp_10.42.42.5(pid=23715): Launched 16:41:17.717416 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:41:18.265966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23717): Launched 16:41:18.387247 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:41:18.654784 run patchelf(pid=23718): Launched 16:41:18.831668 run osmo-stp_10.42.42.5(pid=23715): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23715)] 16:41:18.966517 run osmo-stp_10.42.42.5(pid=23715): stdout: | (launched: 2022-12-09_16:41:17.534581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:19.103698 run osmo-stp_10.42.42.5(pid=23715): stderr: | [0;m[38;5;43m20221209164117725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164117725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164117725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164117726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164117726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164117726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164117726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:19.240525 run osmo-stp_10.42.42.5(pid=23715): stdout: | (launched: 2022-12-09_16:41:17.534581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:19.371007 run osmo-stp_10.42.42.5(pid=23715): stderr: | [0;m[38;5;43m20221209164117725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164117725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164117725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164117726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164117726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164117726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164117726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:19.525546 run patchelf(pid=23718): Terminating (SIGINT) 16:41:19.702890 run patchelf(pid=23718): Terminated: ok {rc=0} 16:41:19.830823 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23715): Process ended prematurely: osmo-stp_10.42.42.5(pid=23715) [trial-2361↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23715)] [trial-2361↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 16:41:19.840482 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:41:19.869148 run osmo-hlr_10.42.42.2(pid=23712): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23712)] 16:41:19.919392 run osmo-hlr_10.42.42.2(pid=23712): stdout: | (launched: 2022-12-09_16:41:16.380485) 16:41:19.971382 run osmo-hlr_10.42.42.2(pid=23712): stderr: | [0;m[1;31m20221209164116703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164116703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164116703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164116703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164116703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164116703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164116715 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164116728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164116728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164116728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:20.023691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23711): Terminating (SIGTERM) 16:41:20.065624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23714): Terminating (SIGTERM) 16:41:20.107943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23717): Terminating (SIGTERM) 16:41:20.150336 --- ParallelTerminationStrategy: PID 23711 died... 16:41:20.170202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23711): Terminated: ok {rc=0} 16:41:20.217069 --- ParallelTerminationStrategy: PID 23714 died... 16:41:20.236606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23714): Terminated: ok {rc=0} 16:41:20.283143 --- ParallelTerminationStrategy: PID 23717 died... 16:41:20.302791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23717): Terminated: ok {rc=0} 16:41:20.389921 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 16:41:21.689953 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:41:21.696540 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:41:21.721199 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:41:21.760107 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:41:21.848022 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:41:21.873295 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:41:21.912687 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:41:22.506758 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:41:22.559442 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:22.570791 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:41:22.612246 tst cs_paging_gprs_active.py: using LAC 22356 16:41:22.742262 tst cs_paging_gprs_active.py: using RAC 171 16:41:22.867543 tst cs_paging_gprs_active.py: using CellId 22356 16:41:22.994371 tst cs_paging_gprs_active.py: using BVCI 22357 16:41:23.112259 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:23.123969 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:23.135117 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:23.146743 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:23.158182 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:23.169766 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:23.181545 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:23.192800 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:23.204479 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:23.320322 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:23.437445 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:41:23.639288 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:23.941121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23722): Launched 16:41:24.202815 run iperf3-srv_10.42.42.10(pid=23723): Launched 16:41:24.315513 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:41:24.516172 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:24.817505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23724): Launched 16:41:25.078457 run iperf3-srv_10.42.42.10(pid=23725): Launched 16:41:25.190692 tst cs_paging_gprs_active.py:38: start network... 16:41:25.391556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:25.855175 run create_hlr_db(pid=23726): Launched 16:41:25.979201 bus /gobi_6: Setting Powered False 16:41:27.040196 run create_hlr_db(pid=23726): Terminated: ok {rc=0} 16:41:27.459127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23728): Launched 16:41:27.759456 run osmo-hlr_10.42.42.2(pid=23729): Launched 16:41:27.873507 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:28.403117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23731): Launched 16:41:28.703156 run osmo-stp_10.42.42.5(pid=23732): Launched 16:41:28.817511 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:41:29.333442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23734): Launched 16:41:29.448820 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:41:29.702789 run patchelf(pid=23735): Launched 16:41:29.870697 run osmo-stp_10.42.42.5(pid=23732): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23732)] 16:41:29.999319 run osmo-stp_10.42.42.5(pid=23732): stdout: | (launched: 2022-12-09_16:41:28.647637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:30.129108 run osmo-stp_10.42.42.5(pid=23732): stderr: | [0;m[38;5;43m20221209164128815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164128815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164128816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164128816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164128817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164128817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164128817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:30.258297 run osmo-stp_10.42.42.5(pid=23732): stdout: | (launched: 2022-12-09_16:41:28.647637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:30.381223 run osmo-stp_10.42.42.5(pid=23732): stderr: | [0;m[38;5;43m20221209164128815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164128815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164128816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164128816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164128817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164128817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164128817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:30.527191 run patchelf(pid=23735): Terminating (SIGINT) 16:41:30.695659 run patchelf(pid=23735): Terminated: ok {rc=0} 16:41:30.816799 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23732): Process ended prematurely: osmo-stp_10.42.42.5(pid=23732) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23732)] [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:41:30.826302 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 16:41:30.861153 run osmo-hlr_10.42.42.2(pid=23729): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23729)] 16:41:30.908852 run osmo-hlr_10.42.42.2(pid=23729): stdout: | (launched: 2022-12-09_16:41:27.704424) 16:41:30.958386 run osmo-hlr_10.42.42.2(pid=23729): stderr: | [0;m[1;31m20221209164127881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164127881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164127881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164127881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164127881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164127882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164127894 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164127905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164127905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164127905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:31.008449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23722): Terminating (SIGTERM) 16:41:31.048464 run iperf3-srv_10.42.42.10(pid=23723): Terminating (SIGTERM) 16:41:31.088312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23724): Terminating (SIGTERM) 16:41:31.128264 run iperf3-srv_10.42.42.10(pid=23725): Terminating (SIGTERM) 16:41:31.168017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23728): Terminating (SIGTERM) 16:41:31.208566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23731): Terminating (SIGTERM) 16:41:31.251056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23734): Terminating (SIGTERM) 16:41:31.294139 --- ParallelTerminationStrategy: PID 23722 died... 16:41:31.313586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23722): Terminated: ok {rc=0} 16:41:31.359915 --- ParallelTerminationStrategy: PID 23723 died... 16:41:31.378903 run iperf3-srv_10.42.42.10(pid=23723): Terminated {rc=256} 16:41:31.423033 --- ParallelTerminationStrategy: PID 23724 died... 16:41:31.442040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23724): Terminated: ok {rc=0} 16:41:31.486402 --- ParallelTerminationStrategy: PID 23725 died... 16:41:31.505287 run iperf3-srv_10.42.42.10(pid=23725): Terminated {rc=256} 16:41:31.549225 --- ParallelTerminationStrategy: PID 23728 died... 16:41:31.568099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23728): Terminated: ok {rc=0} 16:41:31.612062 --- ParallelTerminationStrategy: PID 23731 died... 16:41:31.631130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23731): Terminated: ok {rc=0} 16:41:31.675678 --- ParallelTerminationStrategy: PID 23734 died... 16:41:31.694883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23734): Terminated: ok {rc=0} 16:41:31.781038 bus /gobi_0: Setting Powered False 16:41:32.882479 bus /gobi_0: Setting Powered False 16:41:33.998389 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:41:35.149784 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:35.161925 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:41:35.205611 tst iperf3.py: using LAC 22357 16:41:35.333969 tst iperf3.py: using RAC 172 16:41:35.459064 tst iperf3.py: using CellId 22357 16:41:35.585372 tst iperf3.py: using BVCI 22358 16:41:35.694661 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:35.705677 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:35.716601 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:35.727433 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:35.738235 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:35.748895 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:35.759870 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:35.770509 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:35.781765 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:35.899825 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:41:36.118886 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:36.443398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23736): Launched 16:41:36.725095 run iperf3-srv_10.42.42.10(pid=23737): Launched 16:41:36.846291 tst iperf3.py:8: start network... 16:41:37.064650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:37.565238 run create_hlr_db(pid=23738): Launched 16:41:37.688703 bus /gobi_6: Setting Powered False 16:41:38.752606 run create_hlr_db(pid=23738): Terminated: ok {rc=0} 16:41:39.182596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23740): Launched 16:41:39.483651 run osmo-hlr_10.42.42.2(pid=23741): Launched 16:41:39.599463 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:40.134088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23743): Launched 16:41:40.435960 run osmo-stp_10.42.42.5(pid=23744): Launched 16:41:40.550675 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:41:41.071069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23746): Launched 16:41:41.186683 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:41:41.441246 run patchelf(pid=23747): Launched 16:41:41.609250 run osmo-stp_10.42.42.5(pid=23744): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23744)] 16:41:41.737290 run osmo-stp_10.42.42.5(pid=23744): stdout: | (launched: 2022-12-09_16:41:40.380692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:41.866955 run osmo-stp_10.42.42.5(pid=23744): stderr: | [0;m[38;5;43m20221209164140552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164140552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164140552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164140553 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164140553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164140553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164140553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:41.996453 run osmo-stp_10.42.42.5(pid=23744): stdout: | (launched: 2022-12-09_16:41:40.380692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:42.120723 run osmo-stp_10.42.42.5(pid=23744): stderr: | [0;m[38;5;43m20221209164140552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164140552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164140552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164140553 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164140553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164140553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164140553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:42.266715 run patchelf(pid=23747): Terminating (SIGINT) 16:41:42.435577 run patchelf(pid=23747): Terminated: ok {rc=0} 16:41:42.557580 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23744): Process ended prematurely: osmo-stp_10.42.42.5(pid=23744) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23744)] [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 16:41:42.567087 tst iperf3.py:8: Test FAILED (7.5 sec) 16:41:42.594346 run osmo-hlr_10.42.42.2(pid=23741): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23741)] 16:41:42.641948 run osmo-hlr_10.42.42.2(pid=23741): stdout: | (launched: 2022-12-09_16:41:39.428574) 16:41:42.691241 run osmo-hlr_10.42.42.2(pid=23741): stderr: | [0;m[1;31m20221209164139603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164139603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164139603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164139603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164139603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164139603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164139616 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164139626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164139627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164139627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:42.741502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23736): Terminating (SIGTERM) 16:41:42.781282 run iperf3-srv_10.42.42.10(pid=23737): Terminating (SIGTERM) 16:41:42.820727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23740): Terminating (SIGTERM) 16:41:42.859968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23743): Terminating (SIGTERM) 16:41:42.899066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23746): Terminating (SIGTERM) 16:41:42.939089 --- ParallelTerminationStrategy: PID 23736 died... 16:41:42.959029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23736): Terminated: ok {rc=0} 16:41:43.002804 --- ParallelTerminationStrategy: PID 23737 died... 16:41:43.021352 run iperf3-srv_10.42.42.10(pid=23737): Terminated {rc=256} 16:41:43.064629 --- ParallelTerminationStrategy: PID 23740 died... 16:41:43.083171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23740): Terminated: ok {rc=0} 16:41:43.127120 --- ParallelTerminationStrategy: PID 23743 died... 16:41:43.145582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23743): Terminated: ok {rc=0} 16:41:43.188840 --- ParallelTerminationStrategy: PID 23746 died... 16:41:43.207637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23746): Terminated: ok {rc=0} 16:41:43.291467 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:41:44.436579 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:44.448304 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:41:44.489712 tst iperf3m4.py: using LAC 22358 16:41:44.609414 tst iperf3m4.py: using RAC 173 16:41:44.726627 tst iperf3m4.py: using CellId 22358 16:41:44.845609 tst iperf3m4.py: using BVCI 22359 16:41:44.954018 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:44.965021 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:44.975803 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:44.986547 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:44.997184 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:45.007871 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:45.018801 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:45.029443 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:41:45.040204 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:45.156071 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:45.280502 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:45.399760 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:41:45.515155 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:41:45.718056 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:46.049169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23748): Launched 16:41:46.332164 run iperf3-srv_10.42.42.10(pid=23749): Launched 16:41:46.454461 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:41:46.664335 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:46.976342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23750): Launched 16:41:47.296211 run iperf3-srv_10.42.42.10(pid=23751): Launched 16:41:47.417847 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:41:47.638072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:47.963941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Launched 16:41:48.247180 run iperf3-srv_10.42.42.10(pid=23753): Launched 16:41:48.368408 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:41:48.587695 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:48.911914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23754): Launched 16:41:49.194852 run iperf3-srv_10.42.42.10(pid=23755): Launched 16:41:49.316239 tst iperf3m4.py:8: start network... 16:41:49.535642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:50.035114 run create_hlr_db(pid=23756): Launched 16:41:50.160835 bus /gobi_6: Setting Powered False 16:41:51.221379 run create_hlr_db(pid=23756): Terminated: ok {rc=0} 16:41:51.661012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23758): Launched 16:41:51.983773 run osmo-hlr_10.42.42.2(pid=23759): Launched 16:41:52.106895 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:52.661445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23761): Launched 16:41:52.983357 run osmo-stp_10.42.42.5(pid=23762): Launched 16:41:53.106680 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:41:53.662723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23764): Launched 16:41:53.783348 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:41:54.038905 run patchelf(pid=23765): Launched 16:41:54.207339 run osmo-stp_10.42.42.5(pid=23762): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23762)] 16:41:54.334756 run osmo-stp_10.42.42.5(pid=23762): stdout: | (launched: 2022-12-09_16:41:52.924544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:54.463708 run osmo-stp_10.42.42.5(pid=23762): stderr: | [0;m[38;5;43m20221209164153112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164153112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164153112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164153113 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164153113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164153113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164153113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:54.592567 run osmo-stp_10.42.42.5(pid=23762): stdout: | (launched: 2022-12-09_16:41:52.924544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:54.715663 run osmo-stp_10.42.42.5(pid=23762): stderr: | [0;m[38;5;43m20221209164153112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164153112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164153112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164153113 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164153113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164153113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164153113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:54.860523 run patchelf(pid=23765): Terminating (SIGINT) 16:41:55.029227 run patchelf(pid=23765): Terminated: ok {rc=0} 16:41:55.151515 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23762): Process ended prematurely: osmo-stp_10.42.42.5(pid=23762) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23762)] [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 16:41:55.160864 tst iperf3m4.py:8: Test FAILED (10.8 sec) 16:41:55.187886 run osmo-hlr_10.42.42.2(pid=23759): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23759)] 16:41:55.234829 run osmo-hlr_10.42.42.2(pid=23759): stdout: | (launched: 2022-12-09_16:41:51.925156) 16:41:55.283902 run osmo-hlr_10.42.42.2(pid=23759): stderr: | [0;m[1;31m20221209164152120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164152120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164152120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164152120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164152120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164152120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164152133 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164152142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164152142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164152142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:55.332895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23748): Terminating (SIGTERM) 16:41:55.372182 run iperf3-srv_10.42.42.10(pid=23749): Terminating (SIGTERM) 16:41:55.411329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23750): Terminating (SIGTERM) 16:41:55.450496 run iperf3-srv_10.42.42.10(pid=23751): Terminating (SIGTERM) 16:41:55.489572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Terminating (SIGTERM) 16:41:55.528781 run iperf3-srv_10.42.42.10(pid=23753): Terminating (SIGTERM) 16:41:55.567897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23754): Terminating (SIGTERM) 16:41:55.607013 run iperf3-srv_10.42.42.10(pid=23755): Terminating (SIGTERM) 16:41:55.646001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23758): Terminating (SIGTERM) 16:41:55.685812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23761): Terminating (SIGTERM) 16:41:55.725160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23764): Terminating (SIGTERM) 16:41:55.764698 --- ParallelTerminationStrategy: PID 23748 died... 16:41:55.783742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23748): Terminated: ok {rc=0} 16:41:55.827355 --- ParallelTerminationStrategy: PID 23749 died... 16:41:55.845708 run iperf3-srv_10.42.42.10(pid=23749): Terminated {rc=256} 16:41:55.889102 --- ParallelTerminationStrategy: PID 23750 died... 16:41:55.907446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23750): Terminated: ok {rc=0} 16:41:55.950684 --- ParallelTerminationStrategy: PID 23751 died... 16:41:55.968935 run iperf3-srv_10.42.42.10(pid=23751): Terminated {rc=256} 16:41:56.012297 --- ParallelTerminationStrategy: PID 23752 died... 16:41:56.030710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Terminated: ok {rc=0} 16:41:56.073945 --- ParallelTerminationStrategy: PID 23753 died... 16:41:56.092305 run iperf3-srv_10.42.42.10(pid=23753): Terminated {rc=256} 16:41:56.135697 --- ParallelTerminationStrategy: PID 23754 died... 16:41:56.154144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23754): Terminated: ok {rc=0} 16:41:56.198353 --- ParallelTerminationStrategy: PID 23755 died... 16:41:56.216835 run iperf3-srv_10.42.42.10(pid=23755): Terminated {rc=256} 16:41:56.259924 --- ParallelTerminationStrategy: PID 23758 died... 16:41:56.278383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23758): Terminated: ok {rc=0} 16:41:56.321805 --- ParallelTerminationStrategy: PID 23761 died... 16:41:56.340225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23761): Terminated: ok {rc=0} 16:41:56.383405 --- ParallelTerminationStrategy: PID 23764 died... 16:41:56.401693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23764): Terminated: ok {rc=0} 16:41:56.484336 bus /gobi_4: Setting Powered False 16:41:57.581979 bus /gobi_4: Setting Powered False 16:41:58.697210 bus /gobi_1: Setting Powered False 16:41:59.793972 bus /gobi_1: Setting Powered False 16:42:00.961994 bus /gobi_0: Setting Powered False 16:42:02.092314 bus /gobi_0: Setting Powered False 16:42:03.208127 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 16:42:04.309988 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:04.322165 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:42:04.363140 tst ping.py: using LAC 22359 16:42:04.486284 tst ping.py: using RAC 174 16:42:04.606554 tst ping.py: using CellId 22359 16:42:04.728312 tst ping.py: using BVCI 22360 16:42:04.842327 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:04.853706 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:04.864837 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:04.876235 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:04.887537 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:04.898910 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:04.910556 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:04.921961 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:42:05.038552 tst ping.py:19: start network... 16:42:05.251521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:05.738422 run create_hlr_db(pid=23771): Launched 16:42:05.857668 bus /gobi_6: Setting Powered False 16:42:06.916585 run create_hlr_db(pid=23771): Terminated: ok {rc=0} 16:42:07.358685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23773): Launched 16:42:07.674498 run osmo-hlr_10.42.42.2(pid=23774): Launched 16:42:07.795005 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:08.341598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23776): Launched 16:42:08.656209 run osmo-stp_10.42.42.5(pid=23777): Launched 16:42:08.775956 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:42:09.321257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23779): Launched 16:42:09.442708 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:42:09.710157 run patchelf(pid=23780): Launched 16:42:09.875184 run osmo-stp_10.42.42.5(pid=23777): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23777)] 16:42:10.000440 run osmo-stp_10.42.42.5(pid=23777): stdout: | (launched: 2022-12-09_16:42:08.598809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:10.127413 run osmo-stp_10.42.42.5(pid=23777): stderr: | [0;m[38;5;43m20221209164208790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164208791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164208791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164208791 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164208792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164208792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164208792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:10.254272 run osmo-stp_10.42.42.5(pid=23777): stdout: | (launched: 2022-12-09_16:42:08.598809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:10.375711 run osmo-stp_10.42.42.5(pid=23777): stderr: | [0;m[38;5;43m20221209164208790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164208791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164208791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164208791 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164208792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164208792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164208792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:10.518571 run patchelf(pid=23780): Terminating (SIGINT) 16:42:10.683947 run patchelf(pid=23780): Terminated: ok {rc=0} 16:42:10.802991 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23777): Process ended prematurely: osmo-stp_10.42.42.5(pid=23777) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23777)] [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 16:42:10.811782 tst ping.py:22: Test FAILED (6.5 sec) 16:42:10.838456 run osmo-hlr_10.42.42.2(pid=23774): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23774)] 16:42:10.885669 run osmo-hlr_10.42.42.2(pid=23774): stdout: | (launched: 2022-12-09_16:42:07.616901) 16:42:10.934457 run osmo-hlr_10.42.42.2(pid=23774): stderr: | [0;m[1;31m20221209164207813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164207813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164207813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164207813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164207813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164207813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164207824 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164207832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164207833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164207833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:10.984119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23773): Terminating (SIGTERM) 16:42:11.023545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23776): Terminating (SIGTERM) 16:42:11.063064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23779): Terminating (SIGTERM) 16:42:11.102689 --- ParallelTerminationStrategy: PID 23773 died... 16:42:11.121749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23773): Terminated: ok {rc=0} 16:42:11.165454 --- ParallelTerminationStrategy: PID 23776 died... 16:42:11.183709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23776): Terminated: ok {rc=0} 16:42:11.227698 --- ParallelTerminationStrategy: PID 23779 died... 16:42:11.246213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23779): Terminated: ok {rc=0} 16:42:11.328557 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:42:12.414623 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:12.427333 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:42:12.472833 tst ping_idle_ping.py: using LAC 22360 16:42:12.598567 tst ping_idle_ping.py: using RAC 175 16:42:12.722221 tst ping_idle_ping.py: using CellId 22360 16:42:12.847298 tst ping_idle_ping.py: using BVCI 22361 16:42:12.962270 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:12.973868 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:12.985134 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:12.997146 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:13.009835 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:13.021254 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:13.033431 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:42:13.045413 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:42:13.163076 tst ping_idle_ping.py:24: start network... 16:42:13.361777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:13.826926 run create_hlr_db(pid=23781): Launched 16:42:13.949136 bus /gobi_6: Setting Powered False 16:42:15.009175 run create_hlr_db(pid=23781): Terminated: ok {rc=0} 16:42:15.444545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23783): Launched 16:42:15.762819 run osmo-hlr_10.42.42.2(pid=23784): Launched 16:42:15.960826 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:16.729112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23786): Launched 16:42:17.061754 run osmo-stp_10.42.42.5(pid=23787): Launched 16:42:17.329516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:42:17.909402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23789): Launched 16:42:18.030700 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:42:18.298764 run patchelf(pid=23790): Launched 16:42:18.476214 run osmo-stp_10.42.42.5(pid=23787): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23787)] 16:42:18.611503 run osmo-stp_10.42.42.5(pid=23787): stdout: | (launched: 2022-12-09_16:42:17.001861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:18.748547 run osmo-stp_10.42.42.5(pid=23787): stderr: | [0;m[38;5;43m20221209164217227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164217227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164217227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164217228 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164217228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164217228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164217228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:18.885682 run osmo-stp_10.42.42.5(pid=23787): stdout: | (launched: 2022-12-09_16:42:17.001861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:19.016265 run osmo-stp_10.42.42.5(pid=23787): stderr: | [0;m[38;5;43m20221209164217227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164217227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164217227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164217228 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164217228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164217228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164217228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:19.171204 run patchelf(pid=23790): Terminating (SIGINT) 16:42:19.348583 run patchelf(pid=23790): Terminated: ok {rc=0} 16:42:19.476417 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23787): Process ended prematurely: osmo-stp_10.42.42.5(pid=23787) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23787)] [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 16:42:19.485920 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 16:42:19.514344 run osmo-hlr_10.42.42.2(pid=23784): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23784)] 16:42:19.564082 run osmo-hlr_10.42.42.2(pid=23784): stdout: | (launched: 2022-12-09_16:42:15.704910) 16:42:19.615645 run osmo-hlr_10.42.42.2(pid=23784): stderr: | [0;m[1;31m20221209164215939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164215939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164215939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164215939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164215939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164215939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164215954 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164215967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164215967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164215967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:19.667542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23783): Terminating (SIGTERM) 16:42:19.709216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23786): Terminating (SIGTERM) 16:42:19.750880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23789): Terminating (SIGTERM) 16:42:19.792761 --- ParallelTerminationStrategy: PID 23783 died... 16:42:19.812681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23783): Terminated: ok {rc=0} 16:42:19.858861 --- ParallelTerminationStrategy: PID 23786 died... 16:42:19.878204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23786): Terminated: ok {rc=0} 16:42:19.924127 --- ParallelTerminationStrategy: PID 23789 died... 16:42:19.943520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23789): Terminated: ok {rc=0} 16:42:20.030490 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:42:21.317269 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:42:21.324316 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:42:21.348929 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:42:21.387858 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:42:21.473733 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:42:21.497049 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:42:21.535788 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:42:22.130895 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:42:22.180246 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:22.191246 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:42:22.251171 tst cs_paging_gprs_active.py: using LAC 22361 16:42:22.368806 tst cs_paging_gprs_active.py: using RAC 176 16:42:22.487116 tst cs_paging_gprs_active.py: using CellId 22361 16:42:22.605664 tst cs_paging_gprs_active.py: using BVCI 22362 16:42:22.714585 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:22.725750 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:22.736530 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:22.747340 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:22.758123 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:22.768849 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:22.779712 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:22.790448 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:22.801411 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:22.921599 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:23.038404 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:42:23.239861 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:23.540878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23794): Launched 16:42:23.802897 run iperf3-srv_10.42.42.10(pid=23795): Launched 16:42:23.915447 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:42:24.116380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:24.418953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23796): Launched 16:42:24.680384 run iperf3-srv_10.42.42.10(pid=23797): Launched 16:42:24.792291 tst cs_paging_gprs_active.py:38: start network... 16:42:24.993459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:25.458404 run create_hlr_db(pid=23798): Launched 16:42:25.581428 bus /gobi_6: Setting Powered False 16:42:26.641629 run create_hlr_db(pid=23798): Terminated: ok {rc=0} 16:42:27.082760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23800): Launched 16:42:27.407997 run osmo-hlr_10.42.42.2(pid=23801): Launched 16:42:27.531760 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:28.089976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23803): Launched 16:42:28.411695 run osmo-stp_10.42.42.5(pid=23804): Launched 16:42:28.535207 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:42:29.090851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23806): Launched 16:42:29.215160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:42:29.487720 run patchelf(pid=23807): Launched 16:42:29.667263 run osmo-stp_10.42.42.5(pid=23804): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23804)] 16:42:29.803623 run osmo-stp_10.42.42.5(pid=23804): stdout: | (launched: 2022-12-09_16:42:28.353145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:29.941489 run osmo-stp_10.42.42.5(pid=23804): stderr: | [0;m[38;5;43m20221209164228543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164228543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164228543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164228544 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164228544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164228544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164228544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:30.079534 run osmo-stp_10.42.42.5(pid=23804): stdout: | (launched: 2022-12-09_16:42:28.353145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:30.211570 run osmo-stp_10.42.42.5(pid=23804): stderr: | [0;m[38;5;43m20221209164228543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164228543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164228543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164228544 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164228544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164228544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164228544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:30.367557 run patchelf(pid=23807): Terminating (SIGINT) 16:42:30.548188 run patchelf(pid=23807): Terminated: ok {rc=0} 16:42:30.678398 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23804): Process ended prematurely: osmo-stp_10.42.42.5(pid=23804) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23804)] [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:42:30.688316 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 16:42:30.716905 run osmo-hlr_10.42.42.2(pid=23801): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23801)] 16:42:30.767139 run osmo-hlr_10.42.42.2(pid=23801): stdout: | (launched: 2022-12-09_16:42:27.349129) 16:42:30.818903 run osmo-hlr_10.42.42.2(pid=23801): stderr: | [0;m[1;31m20221209164227549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164227549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164227549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164227549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164227549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164227549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164227561 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164227569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164227570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164227570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:30.880038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23794): Terminating (SIGTERM) 16:42:30.921368 run iperf3-srv_10.42.42.10(pid=23795): Terminating (SIGTERM) 16:42:30.962770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23796): Terminating (SIGTERM) 16:42:31.003931 run iperf3-srv_10.42.42.10(pid=23797): Terminating (SIGTERM) 16:42:31.045722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23800): Terminating (SIGTERM) 16:42:31.088310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23803): Terminating (SIGTERM) 16:42:31.131540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23806): Terminating (SIGTERM) 16:42:31.174644 --- ParallelTerminationStrategy: PID 23794 died... 16:42:31.193876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23794): Terminated: ok {rc=0} 16:42:31.242480 --- ParallelTerminationStrategy: PID 23795 died... 16:42:31.261839 run iperf3-srv_10.42.42.10(pid=23795): Terminated {rc=256} 16:42:31.306753 --- ParallelTerminationStrategy: PID 23796 died... 16:42:31.326246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23796): Terminated: ok {rc=0} 16:42:31.372212 --- ParallelTerminationStrategy: PID 23797 died... 16:42:31.391421 run iperf3-srv_10.42.42.10(pid=23797): Terminated {rc=256} 16:42:31.437551 --- ParallelTerminationStrategy: PID 23800 died... 16:42:31.456839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23800): Terminated: ok {rc=0} 16:42:31.504795 --- ParallelTerminationStrategy: PID 23803 died... 16:42:31.524681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23803): Terminated: ok {rc=0} 16:42:31.570595 --- ParallelTerminationStrategy: PID 23806 died... 16:42:31.589875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23806): Terminated: ok {rc=0} 16:42:31.678663 bus /gobi_0: Setting Powered False 16:42:32.779853 bus /gobi_0: Setting Powered False 16:42:33.896407 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:42:35.045148 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:35.057314 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:42:35.121418 tst iperf3.py: using LAC 22362 16:42:35.248420 tst iperf3.py: using RAC 177 16:42:35.372749 tst iperf3.py: using CellId 22362 16:42:35.497647 tst iperf3.py: using BVCI 22363 16:42:35.613790 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:35.625280 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:35.636494 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:35.648059 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:35.659555 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:35.671106 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:35.682704 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:35.694148 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:35.705938 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:35.826080 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:42:36.051622 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:36.376276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23808): Launched 16:42:36.657965 run iperf3-srv_10.42.42.10(pid=23809): Launched 16:42:36.779021 tst iperf3.py:8: start network... 16:42:36.996922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:37.494658 run create_hlr_db(pid=23810): Launched 16:42:37.616662 bus /gobi_6: Setting Powered False 16:42:38.680420 run create_hlr_db(pid=23810): Terminated: ok {rc=0} 16:42:39.128313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23812): Launched 16:42:39.449863 run osmo-hlr_10.42.42.2(pid=23813): Launched 16:42:39.572761 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:40.123837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23815): Launched 16:42:40.445307 run osmo-stp_10.42.42.5(pid=23816): Launched 16:42:40.567780 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:42:41.121532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23818): Launched 16:42:41.245460 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:42:41.517511 run patchelf(pid=23819): Launched 16:42:41.697156 run osmo-stp_10.42.42.5(pid=23816): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23816)] 16:42:41.834001 run osmo-stp_10.42.42.5(pid=23816): stdout: | (launched: 2022-12-09_16:42:40.386746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:41.971992 run osmo-stp_10.42.42.5(pid=23816): stderr: | [0;m[38;5;43m20221209164240577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164240577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164240577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164240578 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164240579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164240579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164240579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:42.110449 run osmo-stp_10.42.42.5(pid=23816): stdout: | (launched: 2022-12-09_16:42:40.386746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:42.242562 run osmo-stp_10.42.42.5(pid=23816): stderr: | [0;m[38;5;43m20221209164240577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164240577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164240577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164240578 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164240579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164240579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164240579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:42.398788 run patchelf(pid=23819): Terminating (SIGINT) 16:42:42.579692 run patchelf(pid=23819): Terminated: ok {rc=0} 16:42:42.709974 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23816): Process ended prematurely: osmo-stp_10.42.42.5(pid=23816) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23816)] [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 16:42:42.720071 tst iperf3.py:8: Test FAILED (7.7 sec) 16:42:42.748730 run osmo-hlr_10.42.42.2(pid=23813): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23813)] 16:42:42.798129 run osmo-hlr_10.42.42.2(pid=23813): stdout: | (launched: 2022-12-09_16:42:39.391442) 16:42:42.849230 run osmo-hlr_10.42.42.2(pid=23813): stderr: | [0;m[1;31m20221209164239587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164239588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164239588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164239588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164239588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164239588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164239599 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164239608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164239608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164239608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:42.900813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23808): Terminating (SIGTERM) 16:42:42.942474 run iperf3-srv_10.42.42.10(pid=23809): Terminating (SIGTERM) 16:42:42.983583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23812): Terminating (SIGTERM) 16:42:43.025406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23815): Terminating (SIGTERM) 16:42:43.066937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23818): Terminating (SIGTERM) 16:42:43.108501 --- ParallelTerminationStrategy: PID 23808 died... 16:42:43.128609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23808): Terminated: ok {rc=0} 16:42:43.174604 --- ParallelTerminationStrategy: PID 23809 died... 16:42:43.193947 run iperf3-srv_10.42.42.10(pid=23809): Terminated {rc=256} 16:42:43.239674 --- ParallelTerminationStrategy: PID 23812 died... 16:42:43.258947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23812): Terminated: ok {rc=0} 16:42:43.305225 --- ParallelTerminationStrategy: PID 23815 died... 16:42:43.324434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23815): Terminated: ok {rc=0} 16:42:43.370174 --- ParallelTerminationStrategy: PID 23818 died... 16:42:43.389514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23818): Terminated: ok {rc=0} 16:42:43.476144 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:42:44.625264 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:44.637449 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:42:44.698605 tst iperf3m4.py: using LAC 22363 16:42:44.822607 tst iperf3m4.py: using RAC 178 16:42:44.947046 tst iperf3m4.py: using CellId 22363 16:42:45.075269 tst iperf3m4.py: using BVCI 22364 16:42:45.194467 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:45.206021 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:45.217698 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:45.229117 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:45.240358 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:45.251842 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:45.263491 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:45.274956 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:42:45.286519 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:45.407179 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:45.527217 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:45.646572 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:42:45.765349 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:42:46.001693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:46.325528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23820): Launched 16:42:46.617691 run iperf3-srv_10.42.42.10(pid=23821): Launched 16:42:46.767644 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:42:46.990998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:47.322107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23822): Launched 16:42:47.604902 run iperf3-srv_10.42.42.10(pid=23823): Launched 16:42:47.726392 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:42:47.944500 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:48.269177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23824): Launched 16:42:48.550537 run iperf3-srv_10.42.42.10(pid=23825): Launched 16:42:48.671714 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:42:48.889699 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:42:49.214115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23826): Launched 16:42:49.494639 run iperf3-srv_10.42.42.10(pid=23827): Launched 16:42:49.615172 tst iperf3m4.py:8: start network... 16:42:49.833016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:50.332016 run create_hlr_db(pid=23828): Launched 16:42:50.454096 bus /gobi_6: Setting Powered False 16:42:51.517822 run create_hlr_db(pid=23828): Terminated: ok {rc=0} 16:42:51.950180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23830): Launched 16:42:52.251640 run osmo-hlr_10.42.42.2(pid=23831): Launched 16:42:52.365845 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:52.882565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23833): Launched 16:42:53.181945 run osmo-stp_10.42.42.5(pid=23834): Launched 16:42:53.295297 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:42:53.811143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23836): Launched 16:42:53.926225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:42:54.180530 run patchelf(pid=23837): Launched 16:42:54.347644 run osmo-stp_10.42.42.5(pid=23834): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23834)] 16:42:54.474147 run osmo-stp_10.42.42.5(pid=23834): stdout: | (launched: 2022-12-09_16:42:53.126711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:54.602671 run osmo-stp_10.42.42.5(pid=23834): stderr: | [0;m[38;5;43m20221209164253293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164253293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164253293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164253293 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164253294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164253294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164253294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:54.733524 run osmo-stp_10.42.42.5(pid=23834): stdout: | (launched: 2022-12-09_16:42:53.126711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:54.855925 run osmo-stp_10.42.42.5(pid=23834): stderr: | [0;m[38;5;43m20221209164253293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164253293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164253293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164253293 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164253294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164253294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164253294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:55.000861 run patchelf(pid=23837): Terminating (SIGINT) 16:42:55.169420 run patchelf(pid=23837): Terminated: ok {rc=0} 16:42:55.290870 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23834): Process ended prematurely: osmo-stp_10.42.42.5(pid=23834) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23834)] [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:42:55.300192 tst iperf3m4.py:8: Test FAILED (10.7 sec) 16:42:55.327400 run osmo-hlr_10.42.42.2(pid=23831): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23831)] 16:42:55.374511 run osmo-hlr_10.42.42.2(pid=23831): stdout: | (launched: 2022-12-09_16:42:52.196436) 16:42:55.422949 run osmo-hlr_10.42.42.2(pid=23831): stderr: | [0;m[1;31m20221209164252367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164252367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164252367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164252367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164252367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164252367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164252380 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164252388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164252388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164252388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:55.471793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23820): Terminating (SIGTERM) 16:42:55.510794 run iperf3-srv_10.42.42.10(pid=23821): Terminating (SIGTERM) 16:42:55.549768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23822): Terminating (SIGTERM) 16:42:55.588730 run iperf3-srv_10.42.42.10(pid=23823): Terminating (SIGTERM) 16:42:55.627765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23824): Terminating (SIGTERM) 16:42:55.666787 run iperf3-srv_10.42.42.10(pid=23825): Terminating (SIGTERM) 16:42:55.705726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23826): Terminating (SIGTERM) 16:42:55.744701 run iperf3-srv_10.42.42.10(pid=23827): Terminating (SIGTERM) 16:42:55.783523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23830): Terminating (SIGTERM) 16:42:55.822711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23833): Terminating (SIGTERM) 16:42:55.861616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23836): Terminating (SIGTERM) 16:42:55.900922 --- ParallelTerminationStrategy: PID 23820 died... 16:42:55.919805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23820): Terminated: ok {rc=0} 16:42:55.963278 --- ParallelTerminationStrategy: PID 23821 died... 16:42:55.981627 run iperf3-srv_10.42.42.10(pid=23821): Terminated {rc=256} 16:42:56.025109 --- ParallelTerminationStrategy: PID 23822 died... 16:42:56.043524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23822): Terminated: ok {rc=0} 16:42:56.086817 --- ParallelTerminationStrategy: PID 23823 died... 16:42:56.105286 run iperf3-srv_10.42.42.10(pid=23823): Terminated {rc=256} 16:42:56.148346 --- ParallelTerminationStrategy: PID 23824 died... 16:42:56.166816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23824): Terminated: ok {rc=0} 16:42:56.210095 --- ParallelTerminationStrategy: PID 23825 died... 16:42:56.228343 run iperf3-srv_10.42.42.10(pid=23825): Terminated {rc=256} 16:42:56.271339 --- ParallelTerminationStrategy: PID 23826 died... 16:42:56.289827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23826): Terminated: ok {rc=0} 16:42:56.332900 --- ParallelTerminationStrategy: PID 23827 died... 16:42:56.351178 run iperf3-srv_10.42.42.10(pid=23827): Terminated {rc=256} 16:42:56.394143 --- ParallelTerminationStrategy: PID 23830 died... 16:42:56.412447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23830): Terminated: ok {rc=0} 16:42:56.456046 --- ParallelTerminationStrategy: PID 23833 died... 16:42:56.474382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23833): Terminated: ok {rc=0} 16:42:56.517647 --- ParallelTerminationStrategy: PID 23836 died... 16:42:56.536064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23836): Terminated: ok {rc=0} 16:42:56.620300 bus /gobi_4: Setting Powered False 16:42:57.720942 bus /gobi_4: Setting Powered False 16:42:58.835723 bus /gobi_1: Setting Powered False 16:42:59.934304 bus /gobi_1: Setting Powered False 16:43:01.067663 bus /gobi_0: Setting Powered False 16:43:02.169907 bus /gobi_0: Setting Powered False 16:43:03.290314 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:43:04.392222 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:04.404679 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:43:04.466890 tst ping.py: using LAC 22364 16:43:04.590212 tst ping.py: using RAC 179 16:43:04.714586 tst ping.py: using CellId 22364 16:43:04.831653 tst ping.py: using BVCI 22365 16:43:04.947861 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:04.959377 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:04.970642 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:04.982245 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:04.993824 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:05.005387 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:05.016863 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:05.028316 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:43:05.147576 tst ping.py:19: start network... 16:43:05.362832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:05.851591 run create_hlr_db(pid=23838): Launched 16:43:05.971872 bus /gobi_6: Setting Powered False 16:43:07.034160 run create_hlr_db(pid=23838): Terminated: ok {rc=0} 16:43:07.459444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23840): Launched 16:43:07.755577 run osmo-hlr_10.42.42.2(pid=23841): Launched 16:43:07.868308 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:08.382271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23843): Launched 16:43:08.677182 run osmo-stp_10.42.42.5(pid=23844): Launched 16:43:08.790874 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:43:09.298120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23846): Launched 16:43:09.410103 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:43:09.657930 run patchelf(pid=23847): Launched 16:43:09.821287 run osmo-stp_10.42.42.5(pid=23844): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23844)] 16:43:09.945827 run osmo-stp_10.42.42.5(pid=23844): stdout: | (launched: 2022-12-09_16:43:08.622824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:10.072338 run osmo-stp_10.42.42.5(pid=23844): stderr: | [0;m[38;5;43m20221209164308793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164308793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164308793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164308794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164308794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164308794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164308794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:10.198879 run osmo-stp_10.42.42.5(pid=23844): stdout: | (launched: 2022-12-09_16:43:08.622824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:10.319363 run osmo-stp_10.42.42.5(pid=23844): stderr: | [0;m[38;5;43m20221209164308793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164308793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164308793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164308794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164308794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164308794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164308794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:10.462142 run patchelf(pid=23847): Terminating (SIGINT) 16:43:10.626960 run patchelf(pid=23847): Terminated: ok {rc=0} 16:43:10.745988 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23844): Process ended prematurely: osmo-stp_10.42.42.5(pid=23844) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23844)] [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 16:43:10.754745 tst ping.py:22: Test FAILED (6.4 sec) 16:43:10.781612 run osmo-hlr_10.42.42.2(pid=23841): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23841)] 16:43:10.828422 run osmo-hlr_10.42.42.2(pid=23841): stdout: | (launched: 2022-12-09_16:43:07.700376) 16:43:10.877095 run osmo-hlr_10.42.42.2(pid=23841): stderr: | [0;m[1;31m20221209164307874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164307874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164307874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164307874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164307874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164307875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164307886 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164307895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164307895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164307895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:10.925603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23840): Terminating (SIGTERM) 16:43:10.964562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23843): Terminating (SIGTERM) 16:43:11.003508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23846): Terminating (SIGTERM) 16:43:11.043231 --- ParallelTerminationStrategy: PID 23840 died... 16:43:11.062199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23840): Terminated: ok {rc=0} 16:43:11.105480 --- ParallelTerminationStrategy: PID 23843 died... 16:43:11.123685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23843): Terminated: ok {rc=0} 16:43:11.167107 --- ParallelTerminationStrategy: PID 23846 died... 16:43:11.185503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23846): Terminated: ok {rc=0} 16:43:11.267775 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:43:12.352585 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:12.365465 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:43:12.428611 tst ping_idle_ping.py: using LAC 22365 16:43:12.551857 tst ping_idle_ping.py: using RAC 180 16:43:12.675016 tst ping_idle_ping.py: using CellId 22365 16:43:12.798472 tst ping_idle_ping.py: using BVCI 22366 16:43:12.912359 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:12.923845 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:12.935189 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:12.946666 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:12.957952 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:12.969429 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:12.981003 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:43:12.992349 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:43:13.110630 tst ping_idle_ping.py:24: start network... 16:43:13.326297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:13.817264 run create_hlr_db(pid=23848): Launched 16:43:13.937758 bus /gobi_6: Setting Powered False 16:43:15.000188 run create_hlr_db(pid=23848): Terminated: ok {rc=0} 16:43:15.441767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23850): Launched 16:43:15.756366 run osmo-hlr_10.42.42.2(pid=23851): Launched 16:43:15.914393 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:16.568475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23853): Launched 16:43:16.888400 run osmo-stp_10.42.42.5(pid=23854): Launched 16:43:17.129751 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:43:17.699020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23856): Launched 16:43:17.812092 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:43:18.061064 run patchelf(pid=23857): Launched 16:43:18.225802 run osmo-stp_10.42.42.5(pid=23854): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23854)] 16:43:18.350963 run osmo-stp_10.42.42.5(pid=23854): stdout: | (launched: 2022-12-09_16:43:16.827650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:18.478187 run osmo-stp_10.42.42.5(pid=23854): stderr: | [0;m[38;5;43m20221209164317135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164317135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164317135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164317135 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164317136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164317136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164317136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:18.605157 run osmo-stp_10.42.42.5(pid=23854): stdout: | (launched: 2022-12-09_16:43:16.827650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:18.725955 run osmo-stp_10.42.42.5(pid=23854): stderr: | [0;m[38;5;43m20221209164317135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164317135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164317135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164317135 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164317136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164317136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164317136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:18.869868 run patchelf(pid=23857): Terminating (SIGINT) 16:43:19.034861 run patchelf(pid=23857): Terminated: ok {rc=0} 16:43:19.154229 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23854): Process ended prematurely: osmo-stp_10.42.42.5(pid=23854) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23854)] [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:43:19.162955 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 16:43:19.189389 run osmo-hlr_10.42.42.2(pid=23851): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23851)] 16:43:19.236766 run osmo-hlr_10.42.42.2(pid=23851): stdout: | (launched: 2022-12-09_16:43:15.698872) 16:43:19.285201 run osmo-hlr_10.42.42.2(pid=23851): stderr: | [0;m[1;31m20221209164315937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164315937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164315937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164315937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164315937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164315937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164315955 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164315972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164315972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164315972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:19.333936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23850): Terminating (SIGTERM) 16:43:19.373293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23853): Terminating (SIGTERM) 16:43:19.412718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23856): Terminating (SIGTERM) 16:43:19.452202 --- ParallelTerminationStrategy: PID 23850 died... 16:43:19.471081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23850): Terminated: ok {rc=0} 16:43:19.514612 --- ParallelTerminationStrategy: PID 23853 died... 16:43:19.533234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23853): Terminated: ok {rc=0} 16:43:19.576338 --- ParallelTerminationStrategy: PID 23856 died... 16:43:19.594886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23856): Terminated: ok {rc=0} 16:43:19.679436 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 16:43:20.965921 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:43:20.973340 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:43:20.996864 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:43:21.030872 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:43:21.085212 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:43:21.109157 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:43:21.142867 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:43:21.703127 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:43:21.708142 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:43:21.719669 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:43:21.778103 tst switch_tch_pdch.py: using LAC 22366 16:43:21.901049 tst switch_tch_pdch.py: using RAC 181 16:43:22.025954 tst switch_tch_pdch.py: using CellId 22366 16:43:22.153667 tst switch_tch_pdch.py: using BVCI 22367 16:43:22.263057 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:43:22.274604 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:43:22.286111 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:43:22.298051 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:43:22.309885 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:43:22.321794 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:43:22.333865 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:43:22.345950 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:43:22.466368 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:43:22.583151 tst switch_tch_pdch.py:51: start network... 16:43:22.782441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:23.240008 run create_hlr_db(pid=23861): Launched 16:43:23.363070 bus /gobi_6: Setting Powered False 16:43:24.422292 run create_hlr_db(pid=23861): Terminated: ok {rc=0} 16:43:24.855599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23863): Launched 16:43:25.173379 run osmo-hlr_10.42.42.2(pid=23864): Launched 16:43:25.294984 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:25.840463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23866): Launched 16:43:26.156161 run osmo-stp_10.42.42.5(pid=23867): Launched 16:43:26.277742 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:43:26.822881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23869): Launched 16:43:26.943952 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:43:27.210506 run patchelf(pid=23870): Launched 16:43:27.386388 run osmo-stp_10.42.42.5(pid=23867): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23867)] 16:43:27.519989 run osmo-stp_10.42.42.5(pid=23867): stdout: | (launched: 2022-12-09_16:43:26.098175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:27.655347 run osmo-stp_10.42.42.5(pid=23867): stderr: | [0;m[38;5;43m20221209164326290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164326290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164326290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164326291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164326291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164326291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164326291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:27.790836 run osmo-stp_10.42.42.5(pid=23867): stdout: | (launched: 2022-12-09_16:43:26.098175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:27.919710 run osmo-stp_10.42.42.5(pid=23867): stderr: | [0;m[38;5;43m20221209164326290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164326290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164326290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164326291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164326291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164326291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164326291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:28.072572 run patchelf(pid=23870): Terminating (SIGINT) 16:43:28.249101 run patchelf(pid=23870): Terminated: ok {rc=0} 16:43:28.376219 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23867): Process ended prematurely: osmo-stp_10.42.42.5(pid=23867) [trial-2361↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23867)] [trial-2361↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:43:28.385848 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 16:43:28.414097 run osmo-hlr_10.42.42.2(pid=23864): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23864)] 16:43:28.464086 run osmo-hlr_10.42.42.2(pid=23864): stdout: | (launched: 2022-12-09_16:43:25.115148) 16:43:28.515529 run osmo-hlr_10.42.42.2(pid=23864): stderr: | [0;m[1;31m20221209164325311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164325311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164325311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164325311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164325311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164325311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164325336 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164325347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164325347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164325347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:28.567355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23863): Terminating (SIGTERM) 16:43:28.609037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23866): Terminating (SIGTERM) 16:43:28.650749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23869): Terminating (SIGTERM) 16:43:28.692642 --- ParallelTerminationStrategy: PID 23863 died... 16:43:28.712514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23863): Terminated: ok {rc=0} 16:43:28.758754 --- ParallelTerminationStrategy: PID 23866 died... 16:43:28.778333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23866): Terminated: ok {rc=0} 16:43:28.824349 --- ParallelTerminationStrategy: PID 23869 died... 16:43:28.843912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23869): Terminated: ok {rc=0} 16:43:28.931047 bus /gobi_0: Setting Powered False 16:43:30.028697 bus /gobi_0: Setting Powered False 16:43:31.146607 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 sms:nanobts+band-900 --------------------------------------------------------------------- 16:43:32.396904 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:43:32.402311 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 16:43:32.435709 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 16:43:32.463133 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 16:43:32.515786 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 16:43:32.548644 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 16:43:32.575639 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 16:43:33.122674 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 16:43:33.128209 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:33.139316 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 16:43:33.186598 tst mo_mt_sms.py: using LAC 22367 16:43:33.309471 tst mo_mt_sms.py: using RAC 182 16:43:33.426884 tst mo_mt_sms.py: using CellId 22367 16:43:33.545529 tst mo_mt_sms.py: using BVCI 22368 16:43:33.651605 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:33.662254 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:33.673381 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:33.683924 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:33.694575 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:33.704837 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 16:43:33.817440 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 16:43:33.936504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:34.425076 run create_hlr_db(pid=23874): Launched 16:43:34.545406 bus /gobi_6: Setting Powered False 16:43:35.608121 run create_hlr_db(pid=23874): Terminated: ok {rc=0} 16:43:36.047913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23876): Launched 16:43:36.363818 run osmo-hlr_10.42.42.2(pid=23877): Launched 16:43:36.484640 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:37.030123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23879): Launched 16:43:37.345363 run osmo-stp_10.42.42.5(pid=23880): Launched 16:43:37.466363 run osmo-msc_10.42.42.6: Starting osmo-msc 16:43:38.037389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23882): Launched 16:43:38.353752 run osmo-msc_10.42.42.6(pid=23883): Launched 16:43:38.530256 run osmo-stp_10.42.42.5(pid=23880): ERR: Terminated: ERROR {rc=1} [trial-2361↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23880)] 16:43:38.663851 run osmo-stp_10.42.42.5(pid=23880): stdout: | (launched: 2022-12-09_16:43:37.287734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:38.798275 run osmo-stp_10.42.42.5(pid=23880): stderr: | [0;m[38;5;43m20221209164337477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164337477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164337477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164337478 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164337478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164337478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164337478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:38.931755 run osmo-stp_10.42.42.5(pid=23880): stdout: | (launched: 2022-12-09_16:43:37.287734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:39.058304 run osmo-stp_10.42.42.5(pid=23880): stderr: | [0;m[38;5;43m20221209164337477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164337477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164337477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164337478 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164337478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164337478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164337478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:39.209652 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23880): Process ended prematurely: osmo-stp_10.42.42.5(pid=23880) [trial-2361↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23880)] [trial-2361↪sms:nanobts+band-900↪mo_mt_sms.py:16] 16:43:39.218474 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 16:43:39.245968 run osmo-hlr_10.42.42.2(pid=23877): ERR: Terminated: ERROR {rc=237} [trial-2361↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23877)] 16:43:39.295864 run osmo-hlr_10.42.42.2(pid=23877): stdout: | (launched: 2022-12-09_16:43:36.306387) 16:43:39.347376 run osmo-hlr_10.42.42.2(pid=23877): stderr: | [0;m[1;31m20221209164336501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164336501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164336501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164336501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164336501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164336501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164336513 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164336521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164336521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164336521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:39.418843 run osmo-msc_10.42.42.6(pid=23883): ERR: Terminated: ERROR {rc=2} [trial-2361↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23883)] 16:43:39.468505 run osmo-msc_10.42.42.6(pid=23883): stdout: | (launched: 2022-12-09_16:43:38.295583) 16:43:39.519824 run osmo-msc_10.42.42.6(pid=23883): stderr: | [0;m[38;5;43m20221209164338614 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164338615 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcc4e3fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164338615 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164338615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164338615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164338615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164338617 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164338617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164338617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164338617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:43:39.571654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23876): Terminating (SIGTERM) 16:43:39.613144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23879): Terminating (SIGTERM) 16:43:39.654805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23882): Terminating (SIGTERM) 16:43:39.696703 --- ParallelTerminationStrategy: PID 23876 died... 16:43:39.716364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23876): Terminated: ok {rc=0} 16:43:39.762726 --- ParallelTerminationStrategy: PID 23879 died... 16:43:39.782089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23879): Terminated: ok {rc=0} 16:43:39.828031 --- ParallelTerminationStrategy: PID 23882 died... 16:43:39.847299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23882): Terminated: ok {rc=0} 16:43:39.935200 bus /sierra_3: Setting Powered False 16:43:41.034278 bus /sierra_3: Setting Powered False 16:43:42.154405 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 16:43:43.386101 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:43:43.391254 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 16:43:43.424469 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 16:43:43.431408 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 16:43:43.467853 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 16:43:43.499942 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 16:43:43.506714 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 16:43:44.025867 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2361 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 16:43:44.031662 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 16:43:44.043042 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 16:43:44.089601 tst assert_extension.py: using LAC 22368 16:43:44.216300 tst assert_extension.py: using RAC 183 16:43:44.339129 tst assert_extension.py: using CellId 22368 16:43:44.462607 tst assert_extension.py: using BVCI 22369 16:43:44.576840 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 16:43:44.692498 tst assert_extension.py:10: start nitb and bts... 16:43:44.890593 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:43:45.490592 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23889): Launched 16:43:45.784650 run osmo-nitb_10.42.42.2(pid=23890): Launched 16:43:45.978731 run osmo-nitb_10.42.42.2(pid=23890): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23890)] 16:43:46.137962 run osmo-nitb_10.42.42.2(pid=23890): stdout: | (launched: 2022-12-09_16:43:45.730517) 16:43:46.286830 run osmo-nitb_10.42.42.2(pid=23890): stderr: | (launched: 2022-12-09_16:43:45.774074) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:43:46.434917 run osmo-nitb_10.42.42.2(pid=23890): stdout: | (launched: 2022-12-09_16:43:45.730517) 16:43:46.577224 run osmo-nitb_10.42.42.2(pid=23890): stderr: | (launched: 2022-12-09_16:43:45.774074) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23890): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23890) [trial-2361↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23890)] 16:43:46.919530 tst osmo-nitb_10.42.42.2(pid=23890): stdout: | (launched: 2022-12-09_16:43:45.730517) 16:43:47.048334 tst osmo-nitb_10.42.42.2(pid=23890): stderr: | (launched: 2022-12-09_16:43:45.774074) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:43:47.193891 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23890): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23890) [trial-2361↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23890)] [trial-2361↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 16:43:47.203040 tst assert_extension.py:12: Test FAILED (3.2 sec) 16:43:47.210440 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23889): Terminating (SIGTERM) 16:43:47.421431 --- ParallelTerminationStrategy: PID 23889 died... 16:43:47.442098 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23889): Terminated: ok {rc=0} 16:43:47.527478 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 ussd:nanobts+band-900 --------------------------------------------------------------------- 16:43:48.707900 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:43:48.712935 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 16:43:48.745714 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 16:43:48.772478 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 16:43:48.805888 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 16:43:48.837888 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 16:43:48.864422 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 16:43:49.397383 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2361 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 16:43:49.403489 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:49.415131 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 16:43:49.463611 tst assert_extension.py: using LAC 22369 16:43:49.585744 tst assert_extension.py: using RAC 184 16:43:49.706528 tst assert_extension.py: using CellId 22369 16:43:49.829030 tst assert_extension.py: using BVCI 22370 16:43:49.942685 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:49.953754 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:49.964684 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:49.975748 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:49.987043 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:43:49.998086 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 16:43:50.112535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:50.569686 run create_hlr_db(pid=23895): Launched 16:43:50.691479 bus /sierra_2: Setting Powered False 16:43:51.750645 run create_hlr_db(pid=23895): Terminated: ok {rc=0} 16:43:52.185156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23897): Launched 16:43:52.503340 run osmo-hlr_10.42.42.2(pid=23898): Launched 16:43:52.626407 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:53.177114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23900): Launched 16:43:53.492621 run osmo-stp_10.42.42.5(pid=23901): Launched 16:43:53.614348 run osmo-msc_10.42.42.6: Starting osmo-msc 16:43:54.183281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23903): Launched 16:43:54.498068 run osmo-msc_10.42.42.6(pid=23904): Launched 16:43:54.675136 run osmo-stp_10.42.42.5(pid=23901): ERR: Terminated: ERROR {rc=1} [trial-2361↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23901)] 16:43:54.808919 run osmo-stp_10.42.42.5(pid=23901): stdout: | (launched: 2022-12-09_16:43:53.435154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:54.943353 run osmo-stp_10.42.42.5(pid=23901): stderr: | [0;m[38;5;43m20221209164353626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164353626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164353626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164353627 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164353627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164353627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164353627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:55.076923 run osmo-stp_10.42.42.5(pid=23901): stdout: | (launched: 2022-12-09_16:43:53.435154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:55.203861 run osmo-stp_10.42.42.5(pid=23901): stderr: | [0;m[38;5;43m20221209164353626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164353626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164353626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164353627 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164353627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164353627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164353627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:55.355003 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23901): Process ended prematurely: osmo-stp_10.42.42.5(pid=23901) [trial-2361↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23901)] [trial-2361↪ussd:nanobts+band-900↪assert_extension.py:17] 16:43:55.363703 tst assert_extension.py:17: Test FAILED (6.0 sec) 16:43:55.391049 run osmo-hlr_10.42.42.2(pid=23898): ERR: Terminated: ERROR {rc=237} [trial-2361↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23898)] 16:43:55.441041 run osmo-hlr_10.42.42.2(pid=23898): stdout: | (launched: 2022-12-09_16:43:52.445340) 16:43:55.492408 run osmo-hlr_10.42.42.2(pid=23898): stderr: | [0;m[1;31m20221209164352641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164352641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164352641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164352641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164352641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164352641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164352653 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164352662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164352662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164352662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:55.564072 run osmo-msc_10.42.42.6(pid=23904): ERR: Terminated: ERROR {rc=2} [trial-2361↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23904)] 16:43:55.613569 run osmo-msc_10.42.42.6(pid=23904): stdout: | (launched: 2022-12-09_16:43:54.440383) 16:43:55.664790 run osmo-msc_10.42.42.6(pid=23904): stderr: | [0;m[38;5;43m20221209164354759 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164354759 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f313805cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164354760 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164354760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164354760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164354760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164354762 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164354762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164354762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164354762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:43:55.716575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23897): Terminating (SIGTERM) 16:43:55.758062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23900): Terminating (SIGTERM) 16:43:55.799441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23903): Terminating (SIGTERM) 16:43:55.841173 --- ParallelTerminationStrategy: PID 23897 died... 16:43:55.860915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23897): Terminated: ok {rc=0} 16:43:55.907135 --- ParallelTerminationStrategy: PID 23900 died... 16:43:55.926417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23900): Terminated: ok {rc=0} 16:43:55.972335 --- ParallelTerminationStrategy: PID 23903 died... 16:43:55.991710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23903): Terminated: ok {rc=0} 16:43:56.078562 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:43:57.291585 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:43:57.299159 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:43:57.331924 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:43:57.359132 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:43:57.409529 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:43:57.441557 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:43:57.467780 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:43:58.024213 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:43:58.078146 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:58.090468 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:43:58.161629 tst mo_mt_call.py: using LAC 22370 16:43:58.280210 tst mo_mt_call.py: using RAC 185 16:43:58.395758 tst mo_mt_call.py: using CellId 22370 16:43:58.511594 tst mo_mt_call.py: using BVCI 22371 16:43:58.621703 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:58.633032 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:58.644236 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:58.655273 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:58.666475 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:43:58.677455 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:43:58.795453 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:43:58.915520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:59.414525 run create_hlr_db(pid=23910): Launched 16:43:59.537877 bus /sierra_2: Setting Powered False 16:44:00.601539 run create_hlr_db(pid=23910): Terminated: ok {rc=0} 16:44:01.061029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23912): Launched 16:44:01.385754 run osmo-hlr_10.42.42.2(pid=23913): Launched 16:44:01.605949 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:02.311762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23915): Launched 16:44:02.612236 run osmo-stp_10.42.42.5(pid=23916): Launched 16:44:02.726806 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:03.267876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23918): Launched 16:44:03.567849 run osmo-msc_10.42.42.6(pid=23919): Launched 16:44:03.735121 run osmo-stp_10.42.42.5(pid=23916): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23916)] 16:44:03.862998 run osmo-stp_10.42.42.5(pid=23916): stdout: | (launched: 2022-12-09_16:44:02.557170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:03.988896 run osmo-stp_10.42.42.5(pid=23916): stderr: | [0;m[38;5;43m20221209164402727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164402727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164402728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164402728 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164402729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164402729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164402729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:04.114018 run osmo-stp_10.42.42.5(pid=23916): stdout: | (launched: 2022-12-09_16:44:02.557170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:04.232921 run osmo-stp_10.42.42.5(pid=23916): stderr: | [0;m[38;5;43m20221209164402727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164402727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164402728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164402728 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164402729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164402729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164402729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:04.375374 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23916): Process ended prematurely: osmo-stp_10.42.42.5(pid=23916) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23916)] [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:44:04.384145 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:44:04.410379 run osmo-hlr_10.42.42.2(pid=23913): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23913)] 16:44:04.457243 run osmo-hlr_10.42.42.2(pid=23913): stdout: | (launched: 2022-12-09_16:44:01.324019) 16:44:04.505982 run osmo-hlr_10.42.42.2(pid=23913): stderr: | [0;m[1;31m20221209164401654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164401654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164401654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164401654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164401654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164401654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164401679 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164401696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164401696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164401696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:04.573883 run osmo-msc_10.42.42.6(pid=23919): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23919)] 16:44:04.620553 run osmo-msc_10.42.42.6(pid=23919): stdout: | (launched: 2022-12-09_16:44:03.513008) 16:44:04.668860 run osmo-msc_10.42.42.6(pid=23919): stderr: | [0;m[38;5;43m20221209164403782 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164403782 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7fdbb7fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164403782 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164403783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164403784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164403784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164403786 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164403786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164403786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164403786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:04.717552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23912): Terminating (SIGTERM) 16:44:04.756166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23915): Terminating (SIGTERM) 16:44:04.795316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23918): Terminating (SIGTERM) 16:44:04.834776 --- ParallelTerminationStrategy: PID 23912 died... 16:44:04.853721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23912): Terminated: ok {rc=0} 16:44:04.897297 --- ParallelTerminationStrategy: PID 23915 died... 16:44:04.915591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23915): Terminated: ok {rc=0} 16:44:04.958890 --- ParallelTerminationStrategy: PID 23918 died... 16:44:04.977332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23918): Terminated: ok {rc=0} 16:44:05.062319 bus /sierra_3: Setting Powered False 16:44:06.161109 bus /sierra_3: Setting Powered False 16:44:07.276307 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:44:08.423770 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:44:08.436188 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:44:08.505429 tst mo_mt_call_osmux.py: using LAC 22371 16:44:08.631829 tst mo_mt_call_osmux.py: using RAC 186 16:44:08.761328 tst mo_mt_call_osmux.py: using CellId 22371 16:44:08.886110 tst mo_mt_call_osmux.py: using BVCI 22372 16:44:09.002139 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:44:09.013846 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:44:09.025351 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:44:09.037087 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:44:09.048867 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:44:09.060553 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:44:09.176583 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:44:09.297399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:09.795178 run create_hlr_db(pid=23921): Launched 16:44:09.917712 bus /sierra_2: Setting Powered False 16:44:10.981462 run create_hlr_db(pid=23921): Terminated: ok {rc=0} 16:44:11.411694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23923): Launched 16:44:11.714060 run osmo-hlr_10.42.42.2(pid=23924): Launched 16:44:11.828322 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:12.358254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23926): Launched 16:44:12.660320 run osmo-stp_10.42.42.5(pid=23927): Launched 16:44:12.775892 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:13.320819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23929): Launched 16:44:13.622352 run osmo-msc_10.42.42.6(pid=23930): Launched 16:44:13.789919 run osmo-stp_10.42.42.5(pid=23927): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23927)] 16:44:13.916816 run osmo-stp_10.42.42.5(pid=23927): stdout: | (launched: 2022-12-09_16:44:12.605096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:14.044009 run osmo-stp_10.42.42.5(pid=23927): stderr: | [0;m[38;5;43m20221209164412772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164412773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164412773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164412773 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164412774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164412774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164412774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:14.169337 run osmo-stp_10.42.42.5(pid=23927): stdout: | (launched: 2022-12-09_16:44:12.605096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:14.288474 run osmo-stp_10.42.42.5(pid=23927): stderr: | [0;m[38;5;43m20221209164412772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164412773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164412773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164412773 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164412774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164412774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164412774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:14.431400 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23927): Process ended prematurely: osmo-stp_10.42.42.5(pid=23927) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23927)] [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:44:14.440310 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 16:44:14.466721 run osmo-hlr_10.42.42.2(pid=23924): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23924)] 16:44:14.513568 run osmo-hlr_10.42.42.2(pid=23924): stdout: | (launched: 2022-12-09_16:44:11.658844) 16:44:14.562250 run osmo-hlr_10.42.42.2(pid=23924): stderr: | [0;m[1;31m20221209164411833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164411833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164411833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164411833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164411833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164411833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164411845 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164411857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164411857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164411857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:14.630463 run osmo-msc_10.42.42.6(pid=23930): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23930)] 16:44:14.677477 run osmo-msc_10.42.42.6(pid=23930): stdout: | (launched: 2022-12-09_16:44:13.567003) 16:44:14.725784 run osmo-msc_10.42.42.6(pid=23930): stderr: | [0;m[38;5;43m20221209164413841 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164413841 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7325013c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164413841 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164413841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164413841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164413841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164413843 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164413843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164413844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164413844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:14.774678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23923): Terminating (SIGTERM) 16:44:14.813810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23926): Terminating (SIGTERM) 16:44:14.853219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23929): Terminating (SIGTERM) 16:44:14.892725 --- ParallelTerminationStrategy: PID 23923 died... 16:44:14.911669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23923): Terminated: ok {rc=0} 16:44:14.955340 --- ParallelTerminationStrategy: PID 23926 died... 16:44:14.973878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23926): Terminated: ok {rc=0} 16:44:15.017240 --- ParallelTerminationStrategy: PID 23929 died... 16:44:15.035862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23929): Terminated: ok {rc=0} 16:44:15.118239 bus /sierra_3: Setting Powered False 16:44:16.230477 bus /sierra_3: Setting Powered False 16:44:17.354456 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:44:18.608095 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:44:18.615991 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:44:18.649375 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:44:18.676651 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:44:18.729902 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:44:18.761327 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:44:18.787338 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:44:19.338980 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:44:19.387234 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:19.398569 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:44:19.464424 tst mo_mt_call.py: using LAC 22372 16:44:19.581863 tst mo_mt_call.py: using RAC 187 16:44:19.699679 tst mo_mt_call.py: using CellId 22372 16:44:19.818833 tst mo_mt_call.py: using BVCI 22373 16:44:19.928446 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:19.939559 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:19.950465 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:19.961610 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:19.972716 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:19.983738 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:44:20.103443 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:44:20.220393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:20.683669 run create_hlr_db(pid=23936): Launched 16:44:20.806504 bus /sierra_2: Setting Powered False 16:44:21.867484 run create_hlr_db(pid=23936): Terminated: ok {rc=0} 16:44:22.306795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23938): Launched 16:44:22.611937 run osmo-hlr_10.42.42.2(pid=23939): Launched 16:44:22.725464 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:23.244543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23941): Launched 16:44:23.545776 run osmo-stp_10.42.42.5(pid=23942): Launched 16:44:23.659885 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:24.200166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23944): Launched 16:44:24.501858 run osmo-msc_10.42.42.6(pid=23945): Launched 16:44:24.670466 run osmo-stp_10.42.42.5(pid=23942): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23942)] 16:44:24.797597 run osmo-stp_10.42.42.5(pid=23942): stdout: | (launched: 2022-12-09_16:44:23.490329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:24.924207 run osmo-stp_10.42.42.5(pid=23942): stderr: | [0;m[38;5;43m20221209164423662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164423662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164423662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164423663 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164423663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164423663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164423663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:25.048629 run osmo-stp_10.42.42.5(pid=23942): stdout: | (launched: 2022-12-09_16:44:23.490329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:25.167400 run osmo-stp_10.42.42.5(pid=23942): stderr: | [0;m[38;5;43m20221209164423662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164423662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164423662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164423663 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164423663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164423663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164423663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:25.310029 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23942): Process ended prematurely: osmo-stp_10.42.42.5(pid=23942) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23942)] [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:44:25.318717 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 16:44:25.344651 run osmo-hlr_10.42.42.2(pid=23939): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23939)] 16:44:25.392081 run osmo-hlr_10.42.42.2(pid=23939): stdout: | (launched: 2022-12-09_16:44:22.557283) 16:44:25.440599 run osmo-hlr_10.42.42.2(pid=23939): stderr: | [0;m[1;31m20221209164422733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164422733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164422733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164422733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164422733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164422733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164422744 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164422753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164422754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164422754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:25.508534 run osmo-msc_10.42.42.6(pid=23945): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23945)] 16:44:25.555275 run osmo-msc_10.42.42.6(pid=23945): stdout: | (launched: 2022-12-09_16:44:24.445012) 16:44:25.603819 run osmo-msc_10.42.42.6(pid=23945): stderr: | [0;m[38;5;43m20221209164424717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164424717 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f94a22a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164424717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164424717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164424717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164424717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164424720 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164424721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164424721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164424721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:25.652486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23938): Terminating (SIGTERM) 16:44:25.691720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23941): Terminating (SIGTERM) 16:44:25.730927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23944): Terminating (SIGTERM) 16:44:25.770455 --- ParallelTerminationStrategy: PID 23938 died... 16:44:25.789323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23938): Terminated: ok {rc=0} 16:44:25.833148 --- ParallelTerminationStrategy: PID 23941 died... 16:44:25.851275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23941): Terminated: ok {rc=0} 16:44:25.894450 --- ParallelTerminationStrategy: PID 23944 died... 16:44:25.912874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23944): Terminated: ok {rc=0} 16:44:25.995337 bus /sierra_3: Setting Powered False 16:44:27.093921 bus /sierra_3: Setting Powered False 16:44:28.209352 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:44:29.359666 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:29.372015 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:44:29.439719 tst mo_mt_call_osmux.py: using LAC 22373 16:44:29.564714 tst mo_mt_call_osmux.py: using RAC 188 16:44:29.689344 tst mo_mt_call_osmux.py: using CellId 22373 16:44:29.814646 tst mo_mt_call_osmux.py: using BVCI 22374 16:44:29.923810 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:29.934992 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:29.946026 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:29.956899 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:29.968105 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:44:29.978976 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:44:30.097642 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:44:30.218445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:30.717201 run create_hlr_db(pid=23947): Launched 16:44:30.850690 bus /sierra_2: Setting Powered False 16:44:31.915643 run create_hlr_db(pid=23947): Terminated: ok {rc=0} 16:44:32.377490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23949): Launched 16:44:32.700102 run osmo-hlr_10.42.42.2(pid=23950): Launched 16:44:32.823656 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:33.377697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23952): Launched 16:44:33.699582 run osmo-stp_10.42.42.5(pid=23953): Launched 16:44:33.822929 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:34.405475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23955): Launched 16:44:34.727088 run osmo-msc_10.42.42.6(pid=23956): Launched 16:44:34.906954 run osmo-stp_10.42.42.5(pid=23953): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23953)] 16:44:35.042652 run osmo-stp_10.42.42.5(pid=23953): stdout: | (launched: 2022-12-09_16:44:33.641097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:35.179240 run osmo-stp_10.42.42.5(pid=23953): stderr: | [0;m[38;5;43m20221209164433831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164433832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164433832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164433832 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164433833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164433833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164433833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:35.315731 run osmo-stp_10.42.42.5(pid=23953): stdout: | (launched: 2022-12-09_16:44:33.641097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:35.443652 run osmo-stp_10.42.42.5(pid=23953): stderr: | [0;m[38;5;43m20221209164433831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164433832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164433832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164433832 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164433833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164433833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164433833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:35.597356 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23953): Process ended prematurely: osmo-stp_10.42.42.5(pid=23953) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23953)] [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:44:35.606918 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:44:35.634994 run osmo-hlr_10.42.42.2(pid=23950): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23950)] 16:44:35.685058 run osmo-hlr_10.42.42.2(pid=23950): stdout: | (launched: 2022-12-09_16:44:32.641605) 16:44:35.736451 run osmo-hlr_10.42.42.2(pid=23950): stderr: | [0;m[1;31m20221209164432837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164432837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164432837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164432837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164432837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164432837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164432849 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164432857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164432857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164432857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:35.808334 run osmo-msc_10.42.42.6(pid=23956): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23956)] 16:44:35.857802 run osmo-msc_10.42.42.6(pid=23956): stdout: | (launched: 2022-12-09_16:44:34.668543) 16:44:35.908593 run osmo-msc_10.42.42.6(pid=23956): stderr: | [0;m[38;5;43m20221209164434988 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164434988 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc8111ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164434988 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164434988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164434988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164434989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164434990 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164434991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164434991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164434991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:35.960227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23949): Terminating (SIGTERM) 16:44:36.001921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23952): Terminating (SIGTERM) 16:44:36.043654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23955): Terminating (SIGTERM) 16:44:36.085575 --- ParallelTerminationStrategy: PID 23949 died... 16:44:36.105363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23949): Terminated: ok {rc=0} 16:44:36.151352 --- ParallelTerminationStrategy: PID 23952 died... 16:44:36.170844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23952): Terminated: ok {rc=0} 16:44:36.217317 --- ParallelTerminationStrategy: PID 23955 died... 16:44:36.236606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23955): Terminated: ok {rc=0} 16:44:36.324202 bus /sierra_3: Setting Powered False 16:44:37.421533 bus /sierra_3: Setting Powered False 16:44:38.538601 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:44:39.789030 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:44:39.797037 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:44:39.830617 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:44:39.858214 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:44:39.911761 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:44:39.944733 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:44:39.972665 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:44:40.523145 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:44:40.575438 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:40.587010 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:44:40.654813 tst mo_mt_call.py: using LAC 22374 16:44:40.781141 tst mo_mt_call.py: using RAC 189 16:44:40.906607 tst mo_mt_call.py: using CellId 22374 16:44:41.032010 tst mo_mt_call.py: using BVCI 22375 16:44:41.148229 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:41.159957 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:41.171574 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:41.183365 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:41.195576 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:41.207761 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:44:41.325433 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:44:41.441231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:41.907391 run create_hlr_db(pid=23961): Launched 16:44:42.030919 bus /sierra_2: Setting Powered False 16:44:43.090867 run create_hlr_db(pid=23961): Terminated: ok {rc=0} 16:44:43.530604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23963): Launched 16:44:43.853955 run osmo-hlr_10.42.42.2(pid=23964): Launched 16:44:43.977077 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:44.529557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23966): Launched 16:44:44.850465 run osmo-stp_10.42.42.5(pid=23967): Launched 16:44:44.972932 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:45.555523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23969): Launched 16:44:45.885515 run osmo-msc_10.42.42.6(pid=23970): Launched 16:44:46.259139 run osmo-stp_10.42.42.5(pid=23967): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23967)] 16:44:46.487485 run osmo-stp_10.42.42.5(pid=23967): stdout: | (launched: 2022-12-09_16:44:44.792047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:46.623992 run osmo-stp_10.42.42.5(pid=23967): stderr: | [0;m[38;5;43m20221209164444982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164444982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164444982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164444983 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164444983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164444983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164444983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:46.760214 run osmo-stp_10.42.42.5(pid=23967): stdout: | (launched: 2022-12-09_16:44:44.792047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:46.890466 run osmo-stp_10.42.42.5(pid=23967): stderr: | [0;m[38;5;43m20221209164444982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164444982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164444982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164444983 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164444983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164444983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164444983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:47.046499 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23967): Process ended prematurely: osmo-stp_10.42.42.5(pid=23967) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23967)] [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:44:47.056579 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:44:47.085639 run osmo-hlr_10.42.42.2(pid=23964): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23964)] 16:44:47.136356 run osmo-hlr_10.42.42.2(pid=23964): stdout: | (launched: 2022-12-09_16:44:43.794618) 16:44:47.189609 run osmo-hlr_10.42.42.2(pid=23964): stderr: | [0;m[1;31m20221209164443991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164443991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164443991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164443991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164443992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164443992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164444004 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164444013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164444013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164444013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:47.262919 run osmo-msc_10.42.42.6(pid=23970): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23970)] 16:44:47.314798 run osmo-msc_10.42.42.6(pid=23970): stdout: | (launched: 2022-12-09_16:44:45.818736) 16:44:47.367610 run osmo-msc_10.42.42.6(pid=23970): stderr: | [0;m[38;5;43m20221209164446208 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164446208 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3e647f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164446210 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164446210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164446210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164446210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164446213 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164446214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164446214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164446214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:47.419846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23963): Terminating (SIGTERM) 16:44:47.461481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23966): Terminating (SIGTERM) 16:44:47.503236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23969): Terminating (SIGTERM) 16:44:47.545558 --- ParallelTerminationStrategy: PID 23963 died... 16:44:47.565552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23963): Terminated: ok {rc=0} 16:44:47.611746 --- ParallelTerminationStrategy: PID 23966 died... 16:44:47.631494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23966): Terminated: ok {rc=0} 16:44:47.677749 --- ParallelTerminationStrategy: PID 23969 died... 16:44:47.697377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23969): Terminated: ok {rc=0} 16:44:47.784370 bus /sierra_3: Setting Powered False 16:44:48.883166 bus /sierra_3: Setting Powered False 16:44:49.997746 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:44:51.144884 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:51.157650 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:44:51.227405 tst mo_mt_call_osmux.py: using LAC 22375 16:44:51.353698 tst mo_mt_call_osmux.py: using RAC 190 16:44:51.486764 tst mo_mt_call_osmux.py: using CellId 22375 16:44:51.612707 tst mo_mt_call_osmux.py: using BVCI 22376 16:44:51.728894 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:51.740740 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:51.752636 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:51.764075 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:51.775879 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:44:51.787601 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:44:51.907272 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:44:52.027609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:52.494435 run create_hlr_db(pid=23972): Launched 16:44:52.619889 bus /sierra_2: Setting Powered False 16:44:53.679579 run create_hlr_db(pid=23972): Terminated: ok {rc=0} 16:44:54.102540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23974): Launched 16:44:54.405909 run osmo-hlr_10.42.42.2(pid=23975): Launched 16:44:54.520359 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:55.055190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23977): Launched 16:44:55.356936 run osmo-stp_10.42.42.5(pid=23978): Launched 16:44:55.471049 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:56.015305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23980): Launched 16:44:56.318247 run osmo-msc_10.42.42.6(pid=23981): Launched 16:44:56.486950 run osmo-stp_10.42.42.5(pid=23978): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23978)] 16:44:56.614866 run osmo-stp_10.42.42.5(pid=23978): stdout: | (launched: 2022-12-09_16:44:55.301802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:56.742424 run osmo-stp_10.42.42.5(pid=23978): stderr: | [0;m[38;5;43m20221209164455473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164455473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164455473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164455473 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164455474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164455474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164455474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:56.868118 run osmo-stp_10.42.42.5(pid=23978): stdout: | (launched: 2022-12-09_16:44:55.301802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:56.987726 run osmo-stp_10.42.42.5(pid=23978): stderr: | [0;m[38;5;43m20221209164455473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164455473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164455473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164455473 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164455474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164455474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164455474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:57.131278 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23978): Process ended prematurely: osmo-stp_10.42.42.5(pid=23978) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23978)] [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:44:57.140344 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 16:44:57.166589 run osmo-hlr_10.42.42.2(pid=23975): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23975)] 16:44:57.213761 run osmo-hlr_10.42.42.2(pid=23975): stdout: | (launched: 2022-12-09_16:44:54.350505) 16:44:57.262625 run osmo-hlr_10.42.42.2(pid=23975): stderr: | [0;m[1;31m20221209164454526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164454526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164454526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164454526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164454526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164454526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164454538 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164454547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164454547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164454547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:57.330485 run osmo-msc_10.42.42.6(pid=23981): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23981)] 16:44:57.377404 run osmo-msc_10.42.42.6(pid=23981): stdout: | (launched: 2022-12-09_16:44:56.262503) 16:44:57.425974 run osmo-msc_10.42.42.6(pid=23981): stderr: | [0;m[38;5;43m20221209164456532 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164456532 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5b267f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164456532 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164456532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164456532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164456533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164456534 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164456535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164456535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164456535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:57.474773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23974): Terminating (SIGTERM) 16:44:57.514171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23977): Terminating (SIGTERM) 16:44:57.554101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23980): Terminating (SIGTERM) 16:44:57.593826 --- ParallelTerminationStrategy: PID 23974 died... 16:44:57.613155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23974): Terminated: ok {rc=0} 16:44:57.657067 --- ParallelTerminationStrategy: PID 23977 died... 16:44:57.675641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23977): Terminated: ok {rc=0} 16:44:57.718887 --- ParallelTerminationStrategy: PID 23980 died... 16:44:57.737366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23980): Terminated: ok {rc=0} 16:44:57.823642 bus /sierra_3: Setting Powered False 16:44:58.923436 bus /sierra_3: Setting Powered False 16:45:00.038728 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:45:01.321123 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:45:01.328767 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:45:01.362614 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:45:01.390546 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:45:01.444705 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:45:01.488883 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:45:01.526713 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:45:02.063316 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:45:02.115457 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:45:02.127426 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:45:02.196203 tst mo_mt_call.py: using LAC 22376 16:45:02.316758 tst mo_mt_call.py: using RAC 191 16:45:02.433352 tst mo_mt_call.py: using CellId 22376 16:45:02.551024 tst mo_mt_call.py: using BVCI 22377 16:45:02.660628 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:45:02.672025 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:45:02.683237 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:45:02.694205 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:45:02.705420 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:45:02.716563 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:45:02.834143 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:45:02.952466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:03.415131 run create_hlr_db(pid=23989): Launched 16:45:03.537517 bus /sierra_2: Setting Powered False 16:45:04.596589 run create_hlr_db(pid=23989): Terminated: ok {rc=0} 16:45:05.033931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23991): Launched 16:45:05.357447 run osmo-hlr_10.42.42.2(pid=23992): Launched 16:45:05.479950 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:06.034172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23994): Launched 16:45:06.357647 run osmo-stp_10.42.42.5(pid=23995): Launched 16:45:06.480460 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:07.059749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23997): Launched 16:45:07.381666 run osmo-msc_10.42.42.6(pid=23998): Launched 16:45:07.561533 run osmo-stp_10.42.42.5(pid=23995): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23995)] 16:45:07.697567 run osmo-stp_10.42.42.5(pid=23995): stdout: | (launched: 2022-12-09_16:45:06.298960) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:07.834404 run osmo-stp_10.42.42.5(pid=23995): stderr: | [0;m[38;5;43m20221209164506490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164506490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164506491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164506491 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164506491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164506492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164506492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:07.970560 run osmo-stp_10.42.42.5(pid=23995): stdout: | (launched: 2022-12-09_16:45:06.298960) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:08.098322 run osmo-stp_10.42.42.5(pid=23995): stderr: | [0;m[38;5;43m20221209164506490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164506490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164506491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164506491 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164506491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164506492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164506492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:08.251693 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23995): Process ended prematurely: osmo-stp_10.42.42.5(pid=23995) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23995)] [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:45:08.261093 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:45:08.289119 run osmo-hlr_10.42.42.2(pid=23992): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23992)] 16:45:08.338917 run osmo-hlr_10.42.42.2(pid=23992): stdout: | (launched: 2022-12-09_16:45:05.298381) 16:45:08.389995 run osmo-hlr_10.42.42.2(pid=23992): stderr: | [0;m[1;31m20221209164505496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164505496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164505496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164505496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164505496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164505496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164505508 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164505516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164505517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164505517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:08.461625 run osmo-msc_10.42.42.6(pid=23998): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23998)] 16:45:08.510881 run osmo-msc_10.42.42.6(pid=23998): stdout: | (launched: 2022-12-09_16:45:07.323241) 16:45:08.562129 run osmo-msc_10.42.42.6(pid=23998): stderr: | [0;m[38;5;43m20221209164507644 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164507644 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f926fe12c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164507644 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164507644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164507644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164507644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164507646 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164507647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164507647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164507647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:08.613496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23991): Terminating (SIGTERM) 16:45:08.654816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23994): Terminating (SIGTERM) 16:45:08.696124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23997): Terminating (SIGTERM) 16:45:08.737864 --- ParallelTerminationStrategy: PID 23991 died... 16:45:08.757612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23991): Terminated: ok {rc=0} 16:45:08.803711 --- ParallelTerminationStrategy: PID 23994 died... 16:45:08.823020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23994): Terminated: ok {rc=0} 16:45:08.868537 --- ParallelTerminationStrategy: PID 23997 died... 16:45:08.887793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23997): Terminated: ok {rc=0} 16:45:08.974002 bus /sierra_3: Setting Powered False 16:45:10.072817 bus /sierra_3: Setting Powered False 16:45:11.187685 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:45:12.332941 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:45:12.345192 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:45:12.412837 tst mo_mt_call_osmux.py: using LAC 22377 16:45:12.531712 tst mo_mt_call_osmux.py: using RAC 192 16:45:12.659217 tst mo_mt_call_osmux.py: using CellId 22377 16:45:12.786631 tst mo_mt_call_osmux.py: using BVCI 22378 16:45:12.898464 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:45:12.909942 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:45:12.921270 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:45:12.932834 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:45:12.944623 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:45:12.956026 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:45:13.078899 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:45:13.200139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:13.667084 run create_hlr_db(pid=24000): Launched 16:45:13.791084 bus /sierra_2: Setting Powered False 16:45:14.851005 run create_hlr_db(pid=24000): Terminated: ok {rc=0} 16:45:15.271453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24002): Launched 16:45:15.573557 run osmo-hlr_10.42.42.2(pid=24003): Launched 16:45:15.686879 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:16.282456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24005): Launched 16:45:16.624833 run osmo-stp_10.42.42.5(pid=24006): Launched 16:45:16.774142 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:17.515622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24008): Launched 16:45:17.840528 run osmo-msc_10.42.42.6(pid=24009): Launched 16:45:18.021509 run osmo-stp_10.42.42.5(pid=24006): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24006)] 16:45:18.157144 run osmo-stp_10.42.42.5(pid=24006): stdout: | (launched: 2022-12-09_16:45:16.564459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:18.294118 run osmo-stp_10.42.42.5(pid=24006): stderr: | [0;m[38;5;43m20221209164516948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164516948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164516949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164516949 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164516949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164516950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164516950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:18.430036 run osmo-stp_10.42.42.5(pid=24006): stdout: | (launched: 2022-12-09_16:45:16.564459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:18.558371 run osmo-stp_10.42.42.5(pid=24006): stderr: | [0;m[38;5;43m20221209164516948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164516948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164516949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164516949 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164516949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164516950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164516950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:18.712694 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24006): Process ended prematurely: osmo-stp_10.42.42.5(pid=24006) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24006)] [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:45:18.722560 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:45:18.751239 run osmo-hlr_10.42.42.2(pid=24003): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24003)] 16:45:18.800817 run osmo-hlr_10.42.42.2(pid=24003): stdout: | (launched: 2022-12-09_16:45:15.518146) 16:45:18.852582 run osmo-hlr_10.42.42.2(pid=24003): stderr: | [0;m[1;31m20221209164515694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164515694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164515694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164515694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164515694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164515694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164515706 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164515715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164515715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164515715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:18.924262 run osmo-msc_10.42.42.6(pid=24009): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24009)] 16:45:18.973834 run osmo-msc_10.42.42.6(pid=24009): stdout: | (launched: 2022-12-09_16:45:17.781541) 16:45:19.025091 run osmo-msc_10.42.42.6(pid=24009): stderr: | [0;m[38;5;43m20221209164518106 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164518106 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff01dfb2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164518106 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164518106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164518106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164518106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164518108 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164518108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164518108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164518109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:19.077105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24002): Terminating (SIGTERM) 16:45:19.118774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24005): Terminating (SIGTERM) 16:45:19.160526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24008): Terminating (SIGTERM) 16:45:19.202706 --- ParallelTerminationStrategy: PID 24002 died... 16:45:19.222775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24002): Terminated: ok {rc=0} 16:45:19.269352 --- ParallelTerminationStrategy: PID 24005 died... 16:45:19.288567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24005): Terminated: ok {rc=0} 16:45:19.335058 --- ParallelTerminationStrategy: PID 24008 died... 16:45:19.354627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24008): Terminated: ok {rc=0} 16:45:19.441500 bus /sierra_3: Setting Powered False 16:45:20.538798 bus /sierra_3: Setting Powered False 16:45:21.656800 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:45:22.902031 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:45:22.909169 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:45:22.940907 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:45:22.967306 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:45:23.020227 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:45:23.052031 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:45:23.078177 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:45:23.629574 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:45:23.677871 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:23.689406 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:45:23.754433 tst mo_mt_call.py: using LAC 22378 16:45:23.870603 tst mo_mt_call.py: using RAC 193 16:45:23.987763 tst mo_mt_call.py: using CellId 22378 16:45:24.103259 tst mo_mt_call.py: using BVCI 22379 16:45:24.211874 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:24.223127 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:24.234217 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:24.245246 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:24.256431 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:24.267422 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:45:24.384866 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:45:24.503284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:24.968034 run create_hlr_db(pid=24014): Launched 16:45:25.091193 bus /sierra_2: Setting Powered False 16:45:26.151152 run create_hlr_db(pid=24014): Terminated: ok {rc=0} 16:45:26.590768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24016): Launched 16:45:26.913085 run osmo-hlr_10.42.42.2(pid=24017): Launched 16:45:27.036250 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:27.591319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24019): Launched 16:45:27.914101 run osmo-stp_10.42.42.5(pid=24020): Launched 16:45:28.036773 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:28.619597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24022): Launched 16:45:28.941663 run osmo-msc_10.42.42.6(pid=24023): Launched 16:45:29.120444 run osmo-stp_10.42.42.5(pid=24020): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24020)] 16:45:29.255851 run osmo-stp_10.42.42.5(pid=24020): stdout: | (launched: 2022-12-09_16:45:27.854870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:29.392285 run osmo-stp_10.42.42.5(pid=24020): stderr: | [0;m[38;5;43m20221209164528046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164528046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164528047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164528047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164528047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164528047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164528047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:29.527306 run osmo-stp_10.42.42.5(pid=24020): stdout: | (launched: 2022-12-09_16:45:27.854870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:29.654955 run osmo-stp_10.42.42.5(pid=24020): stderr: | [0;m[38;5;43m20221209164528046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164528046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164528047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164528047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164528047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164528047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164528047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:29.807727 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24020): Process ended prematurely: osmo-stp_10.42.42.5(pid=24020) [trial-2361↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24020)] [trial-2361↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:45:29.817234 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:45:29.845227 run osmo-hlr_10.42.42.2(pid=24017): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24017)] 16:45:29.895222 run osmo-hlr_10.42.42.2(pid=24017): stdout: | (launched: 2022-12-09_16:45:26.854429) 16:45:29.946761 run osmo-hlr_10.42.42.2(pid=24017): stderr: | [0;m[1;31m20221209164527051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164527051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164527051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164527051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164527051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164527051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164527063 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164527072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164527072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164527072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:30.018673 run osmo-msc_10.42.42.6(pid=24023): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24023)] 16:45:30.068279 run osmo-msc_10.42.42.6(pid=24023): stdout: | (launched: 2022-12-09_16:45:28.882825) 16:45:30.119529 run osmo-msc_10.42.42.6(pid=24023): stderr: | [0;m[38;5;43m20221209164529205 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164529205 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3005d11c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164529205 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164529205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164529206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164529206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164529207 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164529208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164529208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164529208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:30.171201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24016): Terminating (SIGTERM) 16:45:30.213330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24019): Terminating (SIGTERM) 16:45:30.255081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24022): Terminating (SIGTERM) 16:45:30.297306 --- ParallelTerminationStrategy: PID 24016 died... 16:45:30.317144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24016): Terminated: ok {rc=0} 16:45:30.363458 --- ParallelTerminationStrategy: PID 24019 died... 16:45:30.382900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24019): Terminated: ok {rc=0} 16:45:30.428701 --- ParallelTerminationStrategy: PID 24022 died... 16:45:30.448110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24022): Terminated: ok {rc=0} 16:45:30.535552 bus /sierra_3: Setting Powered False 16:45:31.633273 bus /sierra_3: Setting Powered False 16:45:32.751515 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:45:33.896310 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:33.908852 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:45:33.976511 tst mo_mt_call_osmux.py: using LAC 22379 16:45:34.099564 tst mo_mt_call_osmux.py: using RAC 194 16:45:34.216211 tst mo_mt_call_osmux.py: using CellId 22379 16:45:34.331941 tst mo_mt_call_osmux.py: using BVCI 22380 16:45:34.439967 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:34.451236 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:34.462400 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:34.473469 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:34.484549 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:45:34.495520 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:45:34.614635 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:45:34.734645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:35.234414 run create_hlr_db(pid=24025): Launched 16:45:35.358068 bus /sierra_2: Setting Powered False 16:45:36.422142 run create_hlr_db(pid=24025): Terminated: ok {rc=0} 16:45:36.852519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24027): Launched 16:45:37.153572 run osmo-hlr_10.42.42.2(pid=24028): Launched 16:45:37.268700 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:37.784819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24030): Launched 16:45:38.086663 run osmo-stp_10.42.42.5(pid=24031): Launched 16:45:38.201210 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:38.743810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24033): Launched 16:45:39.044807 run osmo-msc_10.42.42.6(pid=24034): Launched 16:45:39.212634 run osmo-stp_10.42.42.5(pid=24031): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24031)] 16:45:39.339716 run osmo-stp_10.42.42.5(pid=24031): stdout: | (launched: 2022-12-09_16:45:38.031350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:39.467444 run osmo-stp_10.42.42.5(pid=24031): stderr: | [0;m[38;5;43m20221209164538202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164538202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164538202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164538203 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164538203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164538203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164538203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:39.592624 run osmo-stp_10.42.42.5(pid=24031): stdout: | (launched: 2022-12-09_16:45:38.031350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:39.711643 run osmo-stp_10.42.42.5(pid=24031): stderr: | [0;m[38;5;43m20221209164538202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164538202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164538202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164538203 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164538203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164538203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164538203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:39.854660 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24031): Process ended prematurely: osmo-stp_10.42.42.5(pid=24031) [trial-2361↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24031)] [trial-2361↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:45:39.863506 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 16:45:39.889668 run osmo-hlr_10.42.42.2(pid=24028): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24028)] 16:45:39.936461 run osmo-hlr_10.42.42.2(pid=24028): stdout: | (launched: 2022-12-09_16:45:37.098383) 16:45:39.985648 run osmo-hlr_10.42.42.2(pid=24028): stderr: | [0;m[1;31m20221209164537277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164537277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164537277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164537277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164537277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164537277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164537289 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164537298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164537298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164537298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:40.053420 run osmo-msc_10.42.42.6(pid=24034): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24034)] 16:45:40.100007 run osmo-msc_10.42.42.6(pid=24034): stdout: | (launched: 2022-12-09_16:45:38.989488) 16:45:40.148118 run osmo-msc_10.42.42.6(pid=24034): stderr: | [0;m[38;5;43m20221209164539264 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164539265 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5fce0e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164539265 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164539265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164539265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164539265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164539267 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164539267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164539268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164539268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:40.196763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24027): Terminating (SIGTERM) 16:45:40.235825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24030): Terminating (SIGTERM) 16:45:40.274804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24033): Terminating (SIGTERM) 16:45:40.314354 --- ParallelTerminationStrategy: PID 24027 died... 16:45:40.333253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24027): Terminated: ok {rc=0} 16:45:40.377017 --- ParallelTerminationStrategy: PID 24030 died... 16:45:40.395532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24030): Terminated: ok {rc=0} 16:45:40.439342 --- ParallelTerminationStrategy: PID 24033 died... 16:45:40.457957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24033): Terminated: ok {rc=0} 16:45:40.540515 bus /sierra_3: Setting Powered False 16:45:41.637360 bus /sierra_3: Setting Powered False 16:45:42.753646 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:45:44.000351 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:45:44.007034 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:45:44.038739 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 16:45:44.065117 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 16:45:44.122205 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:45:44.156207 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 16:45:44.183892 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 16:45:44.728142 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 16:45:44.776390 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:44.787908 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:45:44.835740 tst mo_mt_call.py: using LAC 22380 16:45:44.951008 tst mo_mt_call.py: using RAC 195 16:45:45.066313 tst mo_mt_call.py: using CellId 22380 16:45:45.183701 tst mo_mt_call.py: using BVCI 22381 16:45:45.292048 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:45.303521 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:45.314688 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:45.325921 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:45.337186 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:45.348298 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:45:45.469096 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:45:45.589322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:46.115629 run create_hlr_db(pid=24040): Launched 16:45:46.271482 bus /sierra_2: Setting Powered False 16:45:47.335283 run create_hlr_db(pid=24040): Terminated: ok {rc=0} 16:45:47.765178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24042): Launched 16:45:48.066576 run osmo-hlr_10.42.42.2(pid=24043): Launched 16:45:48.180064 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:48.692385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24045): Launched 16:45:48.993283 run osmo-stp_10.42.42.5(pid=24046): Launched 16:45:49.107848 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:49.649458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24048): Launched 16:45:49.949152 run osmo-msc_10.42.42.6(pid=24049): Launched 16:45:50.118322 run osmo-stp_10.42.42.5(pid=24046): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24046)] 16:45:50.245113 run osmo-stp_10.42.42.5(pid=24046): stdout: | (launched: 2022-12-09_16:45:48.937765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:50.372113 run osmo-stp_10.42.42.5(pid=24046): stderr: | [0;m[38;5;43m20221209164549106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164549106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164549106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164549107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164549109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164549109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164549109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:50.496380 run osmo-stp_10.42.42.5(pid=24046): stdout: | (launched: 2022-12-09_16:45:48.937765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:50.615437 run osmo-stp_10.42.42.5(pid=24046): stderr: | [0;m[38;5;43m20221209164549106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164549106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164549106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164549107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164549109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164549109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164549109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:50.757945 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24046): Process ended prematurely: osmo-stp_10.42.42.5(pid=24046) [trial-2361↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24046)] [trial-2361↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 16:45:50.766569 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 16:45:50.792308 run osmo-hlr_10.42.42.2(pid=24043): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24043)] 16:45:50.839312 run osmo-hlr_10.42.42.2(pid=24043): stdout: | (launched: 2022-12-09_16:45:48.011176) 16:45:50.887772 run osmo-hlr_10.42.42.2(pid=24043): stderr: | [0;m[1;31m20221209164548186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164548186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164548186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164548186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164548186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164548186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164548198 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164548207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164548207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164548207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:50.955807 run osmo-msc_10.42.42.6(pid=24049): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24049)] 16:45:51.002558 run osmo-msc_10.42.42.6(pid=24049): stdout: | (launched: 2022-12-09_16:45:49.893790) 16:45:51.050933 run osmo-msc_10.42.42.6(pid=24049): stderr: | [0;m[38;5;43m20221209164550163 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164550163 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc57355fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164550163 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164550163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164550164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164550164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164550166 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164550166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164550166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164550166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:51.099770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24042): Terminating (SIGTERM) 16:45:51.138875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24045): Terminating (SIGTERM) 16:45:51.177769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24048): Terminating (SIGTERM) 16:45:51.217045 --- ParallelTerminationStrategy: PID 24042 died... 16:45:51.235912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24042): Terminated: ok {rc=0} 16:45:51.279138 --- ParallelTerminationStrategy: PID 24045 died... 16:45:51.297532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24045): Terminated: ok {rc=0} 16:45:51.341225 --- ParallelTerminationStrategy: PID 24048 died... 16:45:51.359421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24048): Terminated: ok {rc=0} 16:45:51.443973 bus /sierra_3: Setting Powered False 16:45:52.544755 bus /sierra_3: Setting Powered False 16:45:53.661349 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 16:45:54.805938 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:54.818159 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:45:54.868382 tst mo_mt_call_osmux.py: using LAC 22381 16:45:54.986597 tst mo_mt_call_osmux.py: using RAC 196 16:45:55.105291 tst mo_mt_call_osmux.py: using CellId 22381 16:45:55.223627 tst mo_mt_call_osmux.py: using BVCI 22382 16:45:55.331648 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:55.343040 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:55.354360 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:55.365635 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:55.376930 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:55.388150 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:45:55.503381 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:45:55.619614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:56.083031 run create_hlr_db(pid=24051): Launched 16:45:56.206636 bus /sierra_2: Setting Powered False 16:45:57.267124 run create_hlr_db(pid=24051): Terminated: ok {rc=0} 16:45:57.706584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24053): Launched 16:45:58.028655 run osmo-hlr_10.42.42.2(pid=24054): Launched 16:45:58.151318 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:58.709749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24056): Launched 16:45:59.033999 run osmo-stp_10.42.42.5(pid=24057): Launched 16:45:59.157438 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:59.740072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24059): Launched 16:46:00.064059 run osmo-msc_10.42.42.6(pid=24060): Launched 16:46:00.244662 run osmo-stp_10.42.42.5(pid=24057): ERR: Terminated: ERROR {rc=1} [trial-2361↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24057)] 16:46:00.380558 run osmo-stp_10.42.42.5(pid=24057): stdout: | (launched: 2022-12-09_16:45:58.975128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:00.517230 run osmo-stp_10.42.42.5(pid=24057): stderr: | [0;m[38;5;43m20221209164559169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164559169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164559169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164559169 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164559170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164559170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164559170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:00.653074 run osmo-stp_10.42.42.5(pid=24057): stdout: | (launched: 2022-12-09_16:45:58.975128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:00.785291 run osmo-stp_10.42.42.5(pid=24057): stderr: | [0;m[38;5;43m20221209164559169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164559169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164559169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164559169 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164559170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164559170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164559170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:00.959467 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24057): Process ended prematurely: osmo-stp_10.42.42.5(pid=24057) [trial-2361↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24057)] [trial-2361↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 16:46:00.969131 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:46:01.000582 run osmo-hlr_10.42.42.2(pid=24054): ERR: Terminated: ERROR {rc=237} [trial-2361↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24054)] 16:46:01.052285 run osmo-hlr_10.42.42.2(pid=24054): stdout: | (launched: 2022-12-09_16:45:57.970011) 16:46:01.106211 run osmo-hlr_10.42.42.2(pid=24054): stderr: | [0;m[1;31m20221209164558171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164558171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164558171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164558171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164558171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164558171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164558186 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164558196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164558196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164558196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:01.180635 run osmo-msc_10.42.42.6(pid=24060): ERR: Terminated: ERROR {rc=2} [trial-2361↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24060)] 16:46:01.232929 run osmo-msc_10.42.42.6(pid=24060): stdout: | (launched: 2022-12-09_16:46:00.004774) 16:46:01.286685 run osmo-msc_10.42.42.6(pid=24060): stderr: | [0;m[38;5;43m20221209164600330 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164600330 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd393ac0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164600330 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164600330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164600330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164600330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164600332 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164600332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164600332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164600333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:46:01.340997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24053): Terminating (SIGTERM) 16:46:01.384906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24056): Terminating (SIGTERM) 16:46:01.429182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24059): Terminating (SIGTERM) 16:46:01.474916 --- ParallelTerminationStrategy: PID 24053 died... 16:46:01.495642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24053): Terminated: ok {rc=0} 16:46:01.546212 --- ParallelTerminationStrategy: PID 24056 died... 16:46:01.566691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24056): Terminated: ok {rc=0} 16:46:01.615936 --- ParallelTerminationStrategy: PID 24059 died... 16:46:01.636412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24059): Terminated: ok {rc=0} 16:46:01.727139 bus /sierra_3: Setting Powered False 16:46:02.822030 bus /sierra_3: Setting Powered False 16:46:03.936382 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 emergency:nanobts+band-900 --------------------------------------------------------------------- 16:46:05.188894 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:46:05.194233 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 16:46:05.225939 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 16:46:05.252393 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 16:46:05.335818 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 16:46:05.367238 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 16:46:05.393775 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 16:46:05.981855 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2361 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 16:46:05.987212 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:46:05.998492 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 16:46:06.047209 tst emergency_mo_mt_call.py: using LAC 22382 16:46:06.172063 tst emergency_mo_mt_call.py: using RAC 197 16:46:06.293363 tst emergency_mo_mt_call.py: using CellId 22382 16:46:06.414300 tst emergency_mo_mt_call.py: using BVCI 22383 16:46:06.527792 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:46:06.539010 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:46:06.549986 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:46:06.560880 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:46:06.572706 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:46:06.583907 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:06.700390 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:06.818367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:07.309570 run create_hlr_db(pid=24066): Launched 16:46:07.430648 bus /sierra_2: Setting Powered False 16:46:08.493200 run create_hlr_db(pid=24066): Terminated: ok {rc=0} 16:46:08.915617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24068): Launched 16:46:09.211337 run osmo-hlr_10.42.42.2(pid=24069): Launched 16:46:09.323606 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:09.843914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24071): Launched 16:46:10.139127 run osmo-stp_10.42.42.5(pid=24072): Launched 16:46:10.262476 tst emergency_mo_mt_call.py: using MSISDN 7273 16:46:10.414106 run osmo-msc_10.42.42.6: Starting osmo-msc 16:46:10.944793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24074): Launched 16:46:11.241222 run osmo-msc_10.42.42.6(pid=24075): Launched 16:46:11.406906 run osmo-stp_10.42.42.5(pid=24072): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24072)] 16:46:11.531818 run osmo-stp_10.42.42.5(pid=24072): stdout: | (launched: 2022-12-09_16:46:10.084470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:11.656867 run osmo-stp_10.42.42.5(pid=24072): stderr: | [0;m[38;5;43m20221209164610255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164610256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164610256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164610256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164610257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164610257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164610257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:11.779958 run osmo-stp_10.42.42.5(pid=24072): stdout: | (launched: 2022-12-09_16:46:10.084470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:11.897955 run osmo-stp_10.42.42.5(pid=24072): stderr: | [0;m[38;5;43m20221209164610255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164610256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164610256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164610256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164610257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164610257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164610257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:12.038851 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=24072): Process ended prematurely: osmo-stp_10.42.42.5(pid=24072) [trial-2361↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24072)] [trial-2361↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 16:46:12.047246 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 16:46:12.073124 run osmo-hlr_10.42.42.2(pid=24069): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24069)] 16:46:12.120471 run osmo-hlr_10.42.42.2(pid=24069): stdout: | (launched: 2022-12-09_16:46:09.156594) 16:46:12.169712 run osmo-hlr_10.42.42.2(pid=24069): stderr: | [0;m[1;31m20221209164609332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164609332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164609332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164609332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164609332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164609332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164609344 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164609353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164609353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164609353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:12.239044 run osmo-msc_10.42.42.6(pid=24075): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24075)] 16:46:12.286460 run osmo-msc_10.42.42.6(pid=24075): stdout: | (launched: 2022-12-09_16:46:11.186215) 16:46:12.335362 run osmo-msc_10.42.42.6(pid=24075): stderr: | [0;m[38;5;43m20221209164611459 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164611460 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f29f1f9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164611460 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164611460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164611460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164611460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164611462 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164611462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164611463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164611463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:46:12.384924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24068): Terminating (SIGTERM) 16:46:12.423995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24071): Terminating (SIGTERM) 16:46:12.463086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24074): Terminating (SIGTERM) 16:46:12.502522 --- ParallelTerminationStrategy: PID 24068 died... 16:46:12.521562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24068): Terminated: ok {rc=0} 16:46:12.565224 --- ParallelTerminationStrategy: PID 24071 died... 16:46:12.583757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24071): Terminated: ok {rc=0} 16:46:12.627178 --- ParallelTerminationStrategy: PID 24074 died... 16:46:12.645665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24074): Terminated: ok {rc=0} 16:46:12.730763 bus /sierra_3: Setting Powered False 16:46:13.831374 bus /sierra_3: Setting Powered False 16:46:14.948297 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 16:46:16.036006 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:46:16.048536 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 16:46:16.099656 tst emergency_preemptive_call.py: using LAC 22383 16:46:16.216258 tst emergency_preemptive_call.py: using RAC 198 16:46:16.335774 tst emergency_preemptive_call.py: using CellId 22383 16:46:16.478308 tst emergency_preemptive_call.py: using BVCI 22384 16:46:16.607470 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:46:16.619916 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:46:16.633276 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:46:16.646358 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:46:16.658393 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 16:46:16.672438 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:16.794536 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:16.918412 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:17.041483 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:17.163915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:17.629388 run create_hlr_db(pid=24077): Launched 16:46:17.750455 bus /sierra_2: Setting Powered False 16:46:18.810109 run create_hlr_db(pid=24077): Terminated: ok {rc=0} 16:46:19.249754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24079): Launched 16:46:19.546879 run osmo-hlr_10.42.42.2(pid=24080): Launched 16:46:19.658799 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:20.181624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24082): Launched 16:46:20.477560 run osmo-stp_10.42.42.5(pid=24083): Launched 16:46:20.606961 tst emergency_preemptive_call.py: using MSISDN 7274 16:46:20.756279 run osmo-msc_10.42.42.6: Starting osmo-msc 16:46:21.285691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24085): Launched 16:46:21.581216 run osmo-msc_10.42.42.6(pid=24086): Launched 16:46:21.744885 run osmo-stp_10.42.42.5(pid=24083): ERR: Terminated: ERROR {rc=1} [trial-2361↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24083)] 16:46:21.869704 run osmo-stp_10.42.42.5(pid=24083): stdout: | (launched: 2022-12-09_16:46:20.422942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:21.994823 run osmo-stp_10.42.42.5(pid=24083): stderr: | [0;m[38;5;43m20221209164620595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164620595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164620595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164620595 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164620596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164620596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164620596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:22.117611 run osmo-stp_10.42.42.5(pid=24083): stdout: | (launched: 2022-12-09_16:46:20.422942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:22.234869 run osmo-stp_10.42.42.5(pid=24083): stderr: | [0;m[38;5;43m20221209164620595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164620595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164620595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164620595 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164620596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164620596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164620596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:22.376110 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24083): Process ended prematurely: osmo-stp_10.42.42.5(pid=24083) [trial-2361↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24083)] [trial-2361↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 16:46:22.384336 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 16:46:22.410122 run osmo-hlr_10.42.42.2(pid=24080): ERR: Terminated: ERROR {rc=237} [trial-2361↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24080)] 16:46:22.457200 run osmo-hlr_10.42.42.2(pid=24080): stdout: | (launched: 2022-12-09_16:46:19.492450) 16:46:22.505501 run osmo-hlr_10.42.42.2(pid=24080): stderr: | [0;m[1;31m20221209164619670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164619670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164619670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164619670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164619670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164619671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164619683 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164619691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164619692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164619692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:22.573816 run osmo-msc_10.42.42.6(pid=24086): ERR: Terminated: ERROR {rc=2} [trial-2361↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24086)] 16:46:22.620751 run osmo-msc_10.42.42.6(pid=24086): stdout: | (launched: 2022-12-09_16:46:21.526569) 16:46:22.669359 run osmo-msc_10.42.42.6(pid=24086): stderr: | [0;m[38;5;43m20221209164621801 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209164621802 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f417f2bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209164621802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209164621802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209164621802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209164621802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209164621804 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209164621804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209164621805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209164621805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:46:22.718248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24079): Terminating (SIGTERM) 16:46:22.757435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24082): Terminating (SIGTERM) 16:46:22.796820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24085): Terminating (SIGTERM) 16:46:22.836481 --- ParallelTerminationStrategy: PID 24079 died... 16:46:22.855425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24079): Terminated: ok {rc=0} 16:46:22.898646 --- ParallelTerminationStrategy: PID 24082 died... 16:46:22.916862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24082): Terminated: ok {rc=0} 16:46:22.960752 --- ParallelTerminationStrategy: PID 24085 died... 16:46:22.979135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24085): Terminated: ok {rc=0} 16:46:23.063700 bus /sierra_9: Setting Powered False 16:46:24.163447 bus /sierra_9: Setting Powered False 16:46:25.279118 bus /sierra_8: Setting Powered False 16:46:26.377077 bus /sierra_8: Setting Powered False 16:46:27.490818 bus /sierra_3: Setting Powered False 16:46:28.587779 bus /sierra_3: Setting Powered False 16:46:29.703516 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:nanobts+band-900 --------------------------------------------------------------------- 16:46:30.986935 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:46:30.992113 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 16:46:31.026322 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 16:46:31.066419 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 16:46:31.154477 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 16:46:31.195468 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 16:46:31.243332 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 16:46:31.822416 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 16:46:31.882101 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:31.894516 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 16:46:31.946288 tst cs_paging_gprs_active.py: using LAC 22384 16:46:32.116863 tst cs_paging_gprs_active.py: using RAC 199 16:46:32.247792 tst cs_paging_gprs_active.py: using CellId 22384 16:46:32.380369 tst cs_paging_gprs_active.py: using BVCI 22385 16:46:32.499261 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:32.510684 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:32.521633 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:32.533508 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:32.545240 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:32.556921 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:32.569109 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:32.580877 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:32.592560 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:32.710494 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:32.833666 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:46:33.053393 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:33.378453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24091): Launched 16:46:33.660159 run iperf3-srv_10.42.42.10(pid=24092): Launched 16:46:33.782126 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:46:34.000113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:34.326255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24093): Launched 16:46:34.607726 run iperf3-srv_10.42.42.10(pid=24094): Launched 16:46:34.728855 tst cs_paging_gprs_active.py:38: start network... 16:46:34.946283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:35.446331 run create_hlr_db(pid=24095): Launched 16:46:35.568939 bus /sierra_2: Setting Powered False 16:46:36.633366 run create_hlr_db(pid=24095): Terminated: ok {rc=0} 16:46:37.065681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24097): Launched 16:46:37.367245 run osmo-hlr_10.42.42.2(pid=24098): Launched 16:46:37.483248 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:38.002955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24100): Launched 16:46:38.305070 run osmo-stp_10.42.42.5(pid=24101): Launched 16:46:38.420591 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:46:38.940099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24103): Launched 16:46:39.056051 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:46:39.311140 run patchelf(pid=24104): Launched 16:46:39.479943 run osmo-stp_10.42.42.5(pid=24101): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24101)] 16:46:39.608065 run osmo-stp_10.42.42.5(pid=24101): stdout: | (launched: 2022-12-09_16:46:38.249490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:39.738245 run osmo-stp_10.42.42.5(pid=24101): stderr: | [0;m[38;5;43m20221209164638418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164638418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164638418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164638419 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164638421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164638421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164638421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:39.868237 run osmo-stp_10.42.42.5(pid=24101): stdout: | (launched: 2022-12-09_16:46:38.249490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:39.992831 run osmo-stp_10.42.42.5(pid=24101): stderr: | [0;m[38;5;43m20221209164638418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164638418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164638418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164638419 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164638421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164638421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164638421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:40.139617 run patchelf(pid=24104): Terminating (SIGINT) 16:46:40.309841 run patchelf(pid=24104): Terminated: ok {rc=0} 16:46:40.433071 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24101): Process ended prematurely: osmo-stp_10.42.42.5(pid=24101) [trial-2361↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24101)] [trial-2361↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 16:46:40.442942 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 16:46:40.470271 run osmo-hlr_10.42.42.2(pid=24098): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24098)] 16:46:40.517621 run osmo-hlr_10.42.42.2(pid=24098): stdout: | (launched: 2022-12-09_16:46:37.312132) 16:46:40.567101 run osmo-hlr_10.42.42.2(pid=24098): stderr: | [0;m[1;31m20221209164637488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164637488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164637488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164637488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164637488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164637488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164637503 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164637514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164637514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164637514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:40.616850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24091): Terminating (SIGTERM) 16:46:40.656751 run iperf3-srv_10.42.42.10(pid=24092): Terminating (SIGTERM) 16:46:40.696452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24093): Terminating (SIGTERM) 16:46:40.736418 run iperf3-srv_10.42.42.10(pid=24094): Terminating (SIGTERM) 16:46:40.776053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24097): Terminating (SIGTERM) 16:46:40.815884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24100): Terminating (SIGTERM) 16:46:40.855711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24103): Terminating (SIGTERM) 16:46:40.895914 --- ParallelTerminationStrategy: PID 24091 died... 16:46:40.915082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24091): Terminated: ok {rc=0} 16:46:40.958972 --- ParallelTerminationStrategy: PID 24092 died... 16:46:40.977647 run iperf3-srv_10.42.42.10(pid=24092): Terminated {rc=256} 16:46:41.021105 --- ParallelTerminationStrategy: PID 24093 died... 16:46:41.039586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24093): Terminated: ok {rc=0} 16:46:41.083113 --- ParallelTerminationStrategy: PID 24094 died... 16:46:41.101670 run iperf3-srv_10.42.42.10(pid=24094): Terminated {rc=256} 16:46:41.144859 --- ParallelTerminationStrategy: PID 24097 died... 16:46:41.163708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24097): Terminated: ok {rc=0} 16:46:41.207017 --- ParallelTerminationStrategy: PID 24100 died... 16:46:41.225516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24100): Terminated: ok {rc=0} 16:46:41.268614 --- ParallelTerminationStrategy: PID 24103 died... 16:46:41.287150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24103): Terminated: ok {rc=0} 16:46:41.370945 bus /gobi_0: Setting Powered False 16:46:42.470837 bus /gobi_0: Setting Powered False 16:46:43.586546 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 16:46:44.735811 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:44.747884 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 16:46:44.799079 tst iperf3.py: using LAC 22385 16:46:44.924717 tst iperf3.py: using RAC 200 16:46:45.050045 tst iperf3.py: using CellId 22385 16:46:45.177343 tst iperf3.py: using BVCI 22386 16:46:45.287949 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:45.299237 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:45.310461 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:45.321570 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:45.332053 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:45.342633 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:45.353235 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:45.363537 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:45.374081 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:45.491384 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:46:45.711678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:46.043230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24105): Launched 16:46:46.355687 run iperf3-srv_10.42.42.10(pid=24106): Launched 16:46:46.488331 tst iperf3.py:8: start network... 16:46:46.699674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:47.181804 run create_hlr_db(pid=24107): Launched 16:46:47.338329 bus /gobi_6: Setting Powered False 16:46:48.398127 run create_hlr_db(pid=24107): Terminated: ok {rc=0} 16:46:48.820311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24109): Launched 16:46:49.122691 run osmo-hlr_10.42.42.2(pid=24110): Launched 16:46:49.237294 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:49.772090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24112): Launched 16:46:50.073878 run osmo-stp_10.42.42.5(pid=24113): Launched 16:46:50.191701 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:46:50.709149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24115): Launched 16:46:50.824427 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:46:51.078060 run patchelf(pid=24116): Launched 16:46:51.246228 run osmo-stp_10.42.42.5(pid=24113): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24113)] 16:46:51.374176 run osmo-stp_10.42.42.5(pid=24113): stdout: | (launched: 2022-12-09_16:46:50.018326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:51.503698 run osmo-stp_10.42.42.5(pid=24113): stderr: | [0;m[38;5;43m20221209164650189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164650189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164650189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164650190 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164650190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164650190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164650190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:51.633170 run osmo-stp_10.42.42.5(pid=24113): stdout: | (launched: 2022-12-09_16:46:50.018326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:51.756327 run osmo-stp_10.42.42.5(pid=24113): stderr: | [0;m[38;5;43m20221209164650189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164650189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164650189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164650190 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164650190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164650190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164650190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:51.902752 run patchelf(pid=24116): Terminating (SIGINT) 16:46:52.071953 run patchelf(pid=24116): Terminated: ok {rc=0} 16:46:52.194172 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24113): Process ended prematurely: osmo-stp_10.42.42.5(pid=24113) [trial-2361↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24113)] [trial-2361↪gprs:nanobts+band-900↪iperf3.py:8] 16:46:52.203880 tst iperf3.py:8: Test FAILED (7.5 sec) 16:46:52.230982 run osmo-hlr_10.42.42.2(pid=24110): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24110)] 16:46:52.278427 run osmo-hlr_10.42.42.2(pid=24110): stdout: | (launched: 2022-12-09_16:46:49.066890) 16:46:52.327189 run osmo-hlr_10.42.42.2(pid=24110): stderr: | [0;m[1;31m20221209164649241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164649242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164649242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164649242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164649242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164649242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164649254 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164649263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164649264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164649264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:52.376479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24105): Terminating (SIGTERM) 16:46:52.416044 run iperf3-srv_10.42.42.10(pid=24106): Terminating (SIGTERM) 16:46:52.455561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24109): Terminating (SIGTERM) 16:46:52.495134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24112): Terminating (SIGTERM) 16:46:52.534868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24115): Terminating (SIGTERM) 16:46:52.574866 --- ParallelTerminationStrategy: PID 24105 died... 16:46:52.593769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24105): Terminated: ok {rc=0} 16:46:52.637676 --- ParallelTerminationStrategy: PID 24106 died... 16:46:52.656257 run iperf3-srv_10.42.42.10(pid=24106): Terminated {rc=256} 16:46:52.699519 --- ParallelTerminationStrategy: PID 24109 died... 16:46:52.718074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24109): Terminated: ok {rc=0} 16:46:52.761311 --- ParallelTerminationStrategy: PID 24112 died... 16:46:52.779851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24112): Terminated: ok {rc=0} 16:46:52.823451 --- ParallelTerminationStrategy: PID 24115 died... 16:46:52.842160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24115): Terminated: ok {rc=0} 16:46:52.927453 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 16:46:54.073836 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:54.085157 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 16:46:54.133370 tst iperf3m4.py: using LAC 22386 16:46:54.252880 tst iperf3m4.py: using RAC 201 16:46:54.381717 tst iperf3m4.py: using CellId 22386 16:46:54.500729 tst iperf3m4.py: using BVCI 22387 16:46:54.610095 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:54.620754 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:54.631355 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:54.641965 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:54.652330 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:54.662906 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:54.673471 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:54.683702 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:46:54.694241 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:54.814867 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:54.935223 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:55.055410 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:46:55.176049 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:46:55.395881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:55.719825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24117): Launched 16:46:56.001354 run iperf3-srv_10.42.42.10(pid=24118): Launched 16:46:56.122552 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:46:56.342163 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:56.667526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24119): Launched 16:46:56.950788 run iperf3-srv_10.42.42.10(pid=24120): Launched 16:46:57.071751 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:46:57.290373 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:57.614813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24121): Launched 16:46:57.896360 run iperf3-srv_10.42.42.10(pid=24122): Launched 16:46:58.017734 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:46:58.235633 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:58.560739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24123): Launched 16:46:58.842456 run iperf3-srv_10.42.42.10(pid=24124): Launched 16:46:58.963490 tst iperf3m4.py:8: start network... 16:46:59.181702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:59.682157 run create_hlr_db(pid=24125): Launched 16:46:59.805652 bus /gobi_6: Setting Powered False 16:47:00.893476 run create_hlr_db(pid=24125): Terminated: ok {rc=0} 16:47:01.346165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24127): Launched 16:47:01.677764 run osmo-hlr_10.42.42.2(pid=24128): Launched 16:47:01.913874 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:02.632815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24130): Launched 16:47:02.958870 run osmo-stp_10.42.42.5(pid=24131): Launched 16:47:03.082814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:47:03.641792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24133): Launched 16:47:03.766034 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:47:04.038538 run patchelf(pid=24134): Launched 16:47:04.218484 run osmo-stp_10.42.42.5(pid=24131): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24131)] 16:47:04.356516 run osmo-stp_10.42.42.5(pid=24131): stdout: | (launched: 2022-12-09_16:47:02.899442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:04.495477 run osmo-stp_10.42.42.5(pid=24131): stderr: | [0;m[38;5;43m20221209164703088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164703088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164703089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164703089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164703090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164703090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164703090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:04.634794 run osmo-stp_10.42.42.5(pid=24131): stdout: | (launched: 2022-12-09_16:47:02.899442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:04.767397 run osmo-stp_10.42.42.5(pid=24131): stderr: | [0;m[38;5;43m20221209164703088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164703088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164703089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164703089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164703090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164703090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164703090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:04.924277 run patchelf(pid=24134): Terminating (SIGINT) 16:47:05.106372 run patchelf(pid=24134): Terminated: ok {rc=0} 16:47:05.238153 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24131): Process ended prematurely: osmo-stp_10.42.42.5(pid=24131) [trial-2361↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24131)] [trial-2361↪gprs:nanobts+band-900↪iperf3m4.py:8] 16:47:05.248320 tst iperf3m4.py:8: Test FAILED (11.2 sec) 16:47:05.277931 run osmo-hlr_10.42.42.2(pid=24128): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24128)] 16:47:05.327795 run osmo-hlr_10.42.42.2(pid=24128): stdout: | (launched: 2022-12-09_16:47:01.614449) 16:47:05.379157 run osmo-hlr_10.42.42.2(pid=24128): stderr: | [0;m[1;31m20221209164701959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164701959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164701959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164701959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164701959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164701959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164701976 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164701984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164701984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164701984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:05.431170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24117): Terminating (SIGTERM) 16:47:05.472781 run iperf3-srv_10.42.42.10(pid=24118): Terminating (SIGTERM) 16:47:05.514322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24119): Terminating (SIGTERM) 16:47:05.556004 run iperf3-srv_10.42.42.10(pid=24120): Terminating (SIGTERM) 16:47:05.597353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24121): Terminating (SIGTERM) 16:47:05.638921 run iperf3-srv_10.42.42.10(pid=24122): Terminating (SIGTERM) 16:47:05.680319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24123): Terminating (SIGTERM) 16:47:05.722075 run iperf3-srv_10.42.42.10(pid=24124): Terminating (SIGTERM) 16:47:05.763437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24127): Terminating (SIGTERM) 16:47:05.804889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24130): Terminating (SIGTERM) 16:47:05.846403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24133): Terminating (SIGTERM) 16:47:05.888092 --- ParallelTerminationStrategy: PID 24117 died... 16:47:05.907886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24117): Terminated: ok {rc=0} 16:47:05.953936 --- ParallelTerminationStrategy: PID 24118 died... 16:47:05.972916 run iperf3-srv_10.42.42.10(pid=24118): Terminated {rc=256} 16:47:06.019111 --- ParallelTerminationStrategy: PID 24119 died... 16:47:06.038511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24119): Terminated: ok {rc=0} 16:47:06.084342 --- ParallelTerminationStrategy: PID 24120 died... 16:47:06.103646 run iperf3-srv_10.42.42.10(pid=24120): Terminated {rc=256} 16:47:06.149554 --- ParallelTerminationStrategy: PID 24121 died... 16:47:06.168900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24121): Terminated: ok {rc=0} 16:47:06.214660 --- ParallelTerminationStrategy: PID 24122 died... 16:47:06.233909 run iperf3-srv_10.42.42.10(pid=24122): Terminated {rc=256} 16:47:06.279881 --- ParallelTerminationStrategy: PID 24123 died... 16:47:06.299103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24123): Terminated: ok {rc=0} 16:47:06.344928 --- ParallelTerminationStrategy: PID 24124 died... 16:47:06.364258 run iperf3-srv_10.42.42.10(pid=24124): Terminated {rc=256} 16:47:06.409807 --- ParallelTerminationStrategy: PID 24127 died... 16:47:06.429094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24127): Terminated: ok {rc=0} 16:47:06.474848 --- ParallelTerminationStrategy: PID 24130 died... 16:47:06.494163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24130): Terminated: ok {rc=0} 16:47:06.540021 --- ParallelTerminationStrategy: PID 24133 died... 16:47:06.559481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24133): Terminated: ok {rc=0} 16:47:06.646985 bus /gobi_4: Setting Powered False 16:47:07.746078 bus /gobi_4: Setting Powered False 16:47:08.861377 bus /gobi_1: Setting Powered False 16:47:09.958776 bus /gobi_1: Setting Powered False 16:47:11.075543 bus /gobi_0: Setting Powered False 16:47:12.172619 bus /gobi_0: Setting Powered False 16:47:13.287845 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900 ping.py ---------------------------------------------- 16:47:14.389634 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:14.401514 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 16:47:14.451033 tst ping.py: using LAC 22387 16:47:14.575609 tst ping.py: using RAC 202 16:47:14.700487 tst ping.py: using CellId 22387 16:47:14.823954 tst ping.py: using BVCI 22388 16:47:14.938240 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:14.949454 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:14.960362 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:14.971517 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:14.982609 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:14.993593 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:15.004813 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:15.015923 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:47:15.135172 tst ping.py:19: start network... 16:47:15.351039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:15.849893 run create_hlr_db(pid=24135): Launched 16:47:16.019850 bus /gobi_6: Setting Powered False 16:47:17.081919 run create_hlr_db(pid=24135): Terminated: ok {rc=0} 16:47:17.530403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24137): Launched 16:47:17.848884 run osmo-hlr_10.42.42.2(pid=24138): Launched 16:47:17.970312 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:18.523340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24140): Launched 16:47:18.842058 run osmo-stp_10.42.42.5(pid=24141): Launched 16:47:18.963130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:47:19.511484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24143): Launched 16:47:19.633335 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:47:19.902204 run patchelf(pid=24144): Launched 16:47:20.079631 run osmo-stp_10.42.42.5(pid=24141): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24141)] 16:47:20.214743 run osmo-stp_10.42.42.5(pid=24141): stdout: | (launched: 2022-12-09_16:47:18.783810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:20.351943 run osmo-stp_10.42.42.5(pid=24141): stderr: | [0;m[38;5;43m20221209164718976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164718976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164718976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164718976 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164718977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164718977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164718977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:20.489232 run osmo-stp_10.42.42.5(pid=24141): stdout: | (launched: 2022-12-09_16:47:18.783810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:20.620099 run osmo-stp_10.42.42.5(pid=24141): stderr: | [0;m[38;5;43m20221209164718976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164718976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164718976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164718976 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164718977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164718977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164718977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:20.775190 run patchelf(pid=24144): Terminating (SIGINT) 16:47:20.952759 run patchelf(pid=24144): Terminated: ok {rc=0} 16:47:21.080550 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24141): Process ended prematurely: osmo-stp_10.42.42.5(pid=24141) [trial-2361↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24141)] [trial-2361↪gprs:nanobts+band-900↪ping.py:22] 16:47:21.090175 tst ping.py:22: Test FAILED (6.7 sec) 16:47:21.119102 run osmo-hlr_10.42.42.2(pid=24138): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24138)] 16:47:21.169501 run osmo-hlr_10.42.42.2(pid=24138): stdout: | (launched: 2022-12-09_16:47:17.790387) 16:47:21.221728 run osmo-hlr_10.42.42.2(pid=24138): stderr: | [0;m[1;31m20221209164717991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164717991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164717991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164717991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164717991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164717992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164718005 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164718013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164718013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164718013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:21.274645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24137): Terminating (SIGTERM) 16:47:21.317218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24140): Terminating (SIGTERM) 16:47:21.359685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24143): Terminating (SIGTERM) 16:47:21.402550 --- ParallelTerminationStrategy: PID 24137 died... 16:47:21.422844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24137): Terminated: ok {rc=0} 16:47:21.470118 --- ParallelTerminationStrategy: PID 24140 died... 16:47:21.489983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24140): Terminated: ok {rc=0} 16:47:21.536886 --- ParallelTerminationStrategy: PID 24143 died... 16:47:21.556904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24143): Terminated: ok {rc=0} 16:47:21.646155 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 16:47:22.734406 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:22.746890 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 16:47:22.798440 tst ping_idle_ping.py: using LAC 22388 16:47:22.916006 tst ping_idle_ping.py: using RAC 203 16:47:23.032439 tst ping_idle_ping.py: using CellId 22388 16:47:23.150953 tst ping_idle_ping.py: using BVCI 22389 16:47:23.258611 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:23.269319 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:23.279884 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:23.290946 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:23.301949 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:23.312905 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:23.324005 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 16:47:23.335040 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 16:47:23.455253 tst ping_idle_ping.py:24: start network... 16:47:23.673218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:24.171283 run create_hlr_db(pid=24145): Launched 16:47:24.293587 bus /gobi_6: Setting Powered False 16:47:25.356879 run create_hlr_db(pid=24145): Terminated: ok {rc=0} 16:47:25.801365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24147): Launched 16:47:26.119956 run osmo-hlr_10.42.42.2(pid=24148): Launched 16:47:26.241679 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:26.793722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24150): Launched 16:47:27.112060 run osmo-stp_10.42.42.5(pid=24151): Launched 16:47:27.233450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:47:27.783955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24153): Launched 16:47:27.905934 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:47:28.174981 run patchelf(pid=24154): Launched 16:47:28.352744 run osmo-stp_10.42.42.5(pid=24151): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24151)] 16:47:28.487322 run osmo-stp_10.42.42.5(pid=24151): stdout: | (launched: 2022-12-09_16:47:27.053888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:28.624045 run osmo-stp_10.42.42.5(pid=24151): stderr: | [0;m[38;5;43m20221209164727244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164727244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164727245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164727245 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164727247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164727247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164727248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:28.761115 run osmo-stp_10.42.42.5(pid=24151): stdout: | (launched: 2022-12-09_16:47:27.053888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:28.891579 run osmo-stp_10.42.42.5(pid=24151): stderr: | [0;m[38;5;43m20221209164727244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164727244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164727245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164727245 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164727247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164727247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164727248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:29.045972 run patchelf(pid=24154): Terminating (SIGINT) 16:47:29.224358 run patchelf(pid=24154): Terminated: ok {rc=0} 16:47:29.353342 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24151): Process ended prematurely: osmo-stp_10.42.42.5(pid=24151) [trial-2361↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24151)] [trial-2361↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 16:47:29.362753 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:47:29.390996 run osmo-hlr_10.42.42.2(pid=24148): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24148)] 16:47:29.441512 run osmo-hlr_10.42.42.2(pid=24148): stdout: | (launched: 2022-12-09_16:47:26.061664) 16:47:29.493416 run osmo-hlr_10.42.42.2(pid=24148): stderr: | [0;m[1;31m20221209164726259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164726259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164726259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164726259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164726259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164726259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164726276 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164726286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164726286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164726286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:29.545387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24147): Terminating (SIGTERM) 16:47:29.587429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24150): Terminating (SIGTERM) 16:47:29.629379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24153): Terminating (SIGTERM) 16:47:29.671598 --- ParallelTerminationStrategy: PID 24147 died... 16:47:29.691550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24147): Terminated: ok {rc=0} 16:47:29.738168 --- ParallelTerminationStrategy: PID 24150 died... 16:47:29.757900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24150): Terminated: ok {rc=0} 16:47:29.804575 --- ParallelTerminationStrategy: PID 24153 died... 16:47:29.824291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24153): Terminated: ok {rc=0} 16:47:29.912325 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 16:47:31.261522 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:47:31.271012 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:47:31.314744 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:47:31.362874 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:47:31.468207 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:47:31.524503 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:47:31.573771 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:47:32.143656 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:47:32.207491 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.218925 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:47:32.273135 tst cs_paging_gprs_active.py: using LAC 22389 16:47:32.392549 tst cs_paging_gprs_active.py: using RAC 204 16:47:32.520602 tst cs_paging_gprs_active.py: using CellId 22389 16:47:32.648902 tst cs_paging_gprs_active.py: using BVCI 22390 16:47:32.760473 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.771606 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.782386 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.793776 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.804888 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.816314 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.827701 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.838804 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.850497 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:32.971014 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:33.091379 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:47:33.312525 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:33.638311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24159): Launched 16:47:33.921249 run iperf3-srv_10.42.42.10(pid=24160): Launched 16:47:34.043087 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:47:34.262240 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:34.589213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24161): Launched 16:47:34.871390 run iperf3-srv_10.42.42.10(pid=24162): Launched 16:47:34.993080 tst cs_paging_gprs_active.py:38: start network... 16:47:35.211266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:35.713383 run create_hlr_db(pid=24163): Launched 16:47:35.838895 bus /gobi_6: Setting Powered False 16:47:36.902987 run create_hlr_db(pid=24163): Terminated: ok {rc=0} 16:47:37.336610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24167): Launched 16:47:37.641640 run osmo-hlr_10.42.42.2(pid=24168): Launched 16:47:37.756492 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:38.292176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24170): Launched 16:47:38.595772 run osmo-stp_10.42.42.5(pid=24171): Launched 16:47:38.710947 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:47:39.233233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24173): Launched 16:47:39.350086 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:47:39.606668 run patchelf(pid=24174): Launched 16:47:39.775681 run osmo-stp_10.42.42.5(pid=24171): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24171)] 16:47:39.904335 run osmo-stp_10.42.42.5(pid=24171): stdout: | (launched: 2022-12-09_16:47:38.539975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:40.034619 run osmo-stp_10.42.42.5(pid=24171): stderr: | [0;m[38;5;43m20221209164738710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164738711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164738711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164738711 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164738712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164738712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164738712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:40.164805 run osmo-stp_10.42.42.5(pid=24171): stdout: | (launched: 2022-12-09_16:47:38.539975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:40.288519 run osmo-stp_10.42.42.5(pid=24171): stderr: | [0;m[38;5;43m20221209164738710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164738711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164738711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164738711 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164738712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164738712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164738712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:40.435780 run patchelf(pid=24174): Terminating (SIGINT) 16:47:40.605383 run patchelf(pid=24174): Terminated: ok {rc=0} 16:47:40.727623 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24171): Process ended prematurely: osmo-stp_10.42.42.5(pid=24171) [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24171)] [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:47:40.737103 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 16:47:40.764000 run osmo-hlr_10.42.42.2(pid=24168): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24168)] 16:47:40.811198 run osmo-hlr_10.42.42.2(pid=24168): stdout: | (launched: 2022-12-09_16:47:37.585825) 16:47:40.859914 run osmo-hlr_10.42.42.2(pid=24168): stderr: | [0;m[1;31m20221209164737763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164737763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164737763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164737763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164737763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164737763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164737775 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164737784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164737785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164737785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:40.909606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24159): Terminating (SIGTERM) 16:47:40.949152 run iperf3-srv_10.42.42.10(pid=24160): Terminating (SIGTERM) 16:47:40.988274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24161): Terminating (SIGTERM) 16:47:41.027488 run iperf3-srv_10.42.42.10(pid=24162): Terminating (SIGTERM) 16:47:41.066635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24167): Terminating (SIGTERM) 16:47:41.105994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24170): Terminating (SIGTERM) 16:47:41.145142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24173): Terminating (SIGTERM) 16:47:41.184560 --- ParallelTerminationStrategy: PID 24159 died... 16:47:41.203704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24159): Terminated: ok {rc=0} 16:47:41.247222 --- ParallelTerminationStrategy: PID 24160 died... 16:47:41.265595 run iperf3-srv_10.42.42.10(pid=24160): Terminated {rc=256} 16:47:41.309013 --- ParallelTerminationStrategy: PID 24161 died... 16:47:41.328054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24161): Terminated: ok {rc=0} 16:47:41.372210 --- ParallelTerminationStrategy: PID 24162 died... 16:47:41.390749 run iperf3-srv_10.42.42.10(pid=24162): Terminated {rc=256} 16:47:41.434183 --- ParallelTerminationStrategy: PID 24167 died... 16:47:41.452698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24167): Terminated: ok {rc=0} 16:47:41.496251 --- ParallelTerminationStrategy: PID 24170 died... 16:47:41.514738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24170): Terminated: ok {rc=0} 16:47:41.558356 --- ParallelTerminationStrategy: PID 24173 died... 16:47:41.576877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24173): Terminated: ok {rc=0} 16:47:41.662762 bus /gobi_0: Setting Powered False 16:47:42.762727 bus /gobi_0: Setting Powered False 16:47:43.878581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:47:45.023592 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:45.035157 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:47:45.086434 tst iperf3.py: using LAC 22390 16:47:45.205357 tst iperf3.py: using RAC 205 16:47:45.322872 tst iperf3.py: using CellId 22390 16:47:45.442834 tst iperf3.py: using BVCI 22391 16:47:45.552866 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:45.563940 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:45.574637 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:45.585487 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:45.596122 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:45.606796 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:45.617679 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:45.628317 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:45.639190 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:45.757026 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:47:46.004941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:46.341867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24175): Launched 16:47:46.636293 run iperf3-srv_10.42.42.10(pid=24176): Launched 16:47:46.794962 tst iperf3.py:8: start network... 16:47:47.075579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:47.594103 run create_hlr_db(pid=24177): Launched 16:47:47.718993 bus /gobi_6: Setting Powered False 16:47:48.782720 run create_hlr_db(pid=24177): Terminated: ok {rc=0} 16:47:49.233262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24179): Launched 16:47:49.557728 run osmo-hlr_10.42.42.2(pid=24180): Launched 16:47:49.680703 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:50.203318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24182): Launched 16:47:50.505147 run osmo-stp_10.42.42.5(pid=24183): Launched 16:47:50.619893 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:47:51.140172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24185): Launched 16:47:51.257038 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:47:51.512928 run patchelf(pid=24186): Launched 16:47:51.682683 run osmo-stp_10.42.42.5(pid=24183): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24183)] 16:47:51.810569 run osmo-stp_10.42.42.5(pid=24183): stdout: | (launched: 2022-12-09_16:47:50.449545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:51.940004 run osmo-stp_10.42.42.5(pid=24183): stderr: | [0;m[38;5;43m20221209164750619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164750619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164750619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164750619 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164750620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164750620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164750620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:52.069714 run osmo-stp_10.42.42.5(pid=24183): stdout: | (launched: 2022-12-09_16:47:50.449545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:52.193242 run osmo-stp_10.42.42.5(pid=24183): stderr: | [0;m[38;5;43m20221209164750619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164750619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164750619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164750619 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164750620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164750620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164750620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:52.339373 run patchelf(pid=24186): Terminating (SIGINT) 16:47:52.508080 run patchelf(pid=24186): Terminated: ok {rc=0} 16:47:52.630358 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24183): Process ended prematurely: osmo-stp_10.42.42.5(pid=24183) [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24183)] [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 16:47:52.639729 tst iperf3.py:8: Test FAILED (7.7 sec) 16:47:52.666955 run osmo-hlr_10.42.42.2(pid=24180): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24180)] 16:47:52.714466 run osmo-hlr_10.42.42.2(pid=24180): stdout: | (launched: 2022-12-09_16:47:49.498687) 16:47:52.763585 run osmo-hlr_10.42.42.2(pid=24180): stderr: | [0;m[1;31m20221209164749697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164749697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164749698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164749698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164749698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164749698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164749710 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164749718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164749718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164749718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:52.813323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24175): Terminating (SIGTERM) 16:47:52.852751 run iperf3-srv_10.42.42.10(pid=24176): Terminating (SIGTERM) 16:47:52.892002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24179): Terminating (SIGTERM) 16:47:52.931423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24182): Terminating (SIGTERM) 16:47:52.970719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24185): Terminating (SIGTERM) 16:47:53.011429 --- ParallelTerminationStrategy: PID 24175 died... 16:47:53.030627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24175): Terminated: ok {rc=0} 16:47:53.074245 --- ParallelTerminationStrategy: PID 24176 died... 16:47:53.092474 run iperf3-srv_10.42.42.10(pid=24176): Terminated {rc=256} 16:47:53.135837 --- ParallelTerminationStrategy: PID 24179 died... 16:47:53.154307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24179): Terminated: ok {rc=0} 16:47:53.197465 --- ParallelTerminationStrategy: PID 24182 died... 16:47:53.215903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24182): Terminated: ok {rc=0} 16:47:53.259520 --- ParallelTerminationStrategy: PID 24185 died... 16:47:53.277962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24185): Terminated: ok {rc=0} 16:47:53.360686 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:47:54.500819 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:54.512519 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:47:54.562586 tst iperf3m4.py: using LAC 22391 16:47:54.689936 tst iperf3m4.py: using RAC 206 16:47:54.816304 tst iperf3m4.py: using CellId 22391 16:47:54.942256 tst iperf3m4.py: using BVCI 22392 16:47:55.059908 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:55.071430 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:55.082805 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:55.094263 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:55.105564 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:55.116791 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:55.128528 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:55.139909 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:55.151480 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:55.269233 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:55.391539 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:55.508740 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:55.627125 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:47:55.831308 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:56.135856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24187): Launched 16:47:56.401696 run iperf3-srv_10.42.42.10(pid=24188): Launched 16:47:56.515789 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:47:56.721489 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:57.026792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24189): Launched 16:47:57.293114 run iperf3-srv_10.42.42.10(pid=24190): Launched 16:47:57.406706 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:47:57.610621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:57.915490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24191): Launched 16:47:58.180671 run iperf3-srv_10.42.42.10(pid=24192): Launched 16:47:58.293846 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:47:58.497257 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:58.802096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24193): Launched 16:47:59.066905 run iperf3-srv_10.42.42.10(pid=24194): Launched 16:47:59.180476 tst iperf3m4.py:8: start network... 16:47:59.383348 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:59.850220 run create_hlr_db(pid=24195): Launched 16:47:59.973929 bus /gobi_6: Setting Powered False 16:48:01.049889 run create_hlr_db(pid=24195): Terminated: ok {rc=0} 16:48:01.545331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24197): Launched 16:48:01.892521 run osmo-hlr_10.42.42.2(pid=24198): Launched 16:48:02.096249 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:02.681660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24200): Launched 16:48:03.006619 run osmo-stp_10.42.42.5(pid=24201): Launched 16:48:03.130436 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:03.690653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24203): Launched 16:48:03.815563 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:04.090029 run patchelf(pid=24204): Launched 16:48:04.270823 run osmo-stp_10.42.42.5(pid=24201): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24201)] 16:48:04.409329 run osmo-stp_10.42.42.5(pid=24201): stdout: | (launched: 2022-12-09_16:48:02.947299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:04.548321 run osmo-stp_10.42.42.5(pid=24201): stderr: | [0;m[38;5;43m20221209164803140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164803140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164803140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164803141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164803141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164803141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164803141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:04.687281 run osmo-stp_10.42.42.5(pid=24201): stdout: | (launched: 2022-12-09_16:48:02.947299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:04.819718 run osmo-stp_10.42.42.5(pid=24201): stderr: | [0;m[38;5;43m20221209164803140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164803140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164803140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164803141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164803141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164803141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164803141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:04.977086 run patchelf(pid=24204): Terminating (SIGINT) 16:48:05.159309 run patchelf(pid=24204): Terminated: ok {rc=0} 16:48:05.290716 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24201): Process ended prematurely: osmo-stp_10.42.42.5(pid=24201) [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24201)] [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 16:48:05.300811 tst iperf3m4.py:8: Test FAILED (10.8 sec) 16:48:05.330292 run osmo-hlr_10.42.42.2(pid=24198): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24198)] 16:48:05.380209 run osmo-hlr_10.42.42.2(pid=24198): stdout: | (launched: 2022-12-09_16:48:01.827804) 16:48:05.431812 run osmo-hlr_10.42.42.2(pid=24198): stderr: | [0;m[1;31m20221209164802198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164802198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164802198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164802198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164802198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164802198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164802216 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164802224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164802224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164802224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:05.483858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24187): Terminating (SIGTERM) 16:48:05.525711 run iperf3-srv_10.42.42.10(pid=24188): Terminating (SIGTERM) 16:48:05.567245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24189): Terminating (SIGTERM) 16:48:05.609118 run iperf3-srv_10.42.42.10(pid=24190): Terminating (SIGTERM) 16:48:05.650718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24191): Terminating (SIGTERM) 16:48:05.692525 run iperf3-srv_10.42.42.10(pid=24192): Terminating (SIGTERM) 16:48:05.733917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24193): Terminating (SIGTERM) 16:48:05.775566 run iperf3-srv_10.42.42.10(pid=24194): Terminating (SIGTERM) 16:48:05.817091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24197): Terminating (SIGTERM) 16:48:05.858590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24200): Terminating (SIGTERM) 16:48:05.900118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24203): Terminating (SIGTERM) 16:48:05.941949 --- ParallelTerminationStrategy: PID 24187 died... 16:48:05.961885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24187): Terminated: ok {rc=0} 16:48:06.008257 --- ParallelTerminationStrategy: PID 24188 died... 16:48:06.028151 run iperf3-srv_10.42.42.10(pid=24188): Terminated {rc=256} 16:48:06.074177 --- ParallelTerminationStrategy: PID 24189 died... 16:48:06.093653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24189): Terminated: ok {rc=0} 16:48:06.139793 --- ParallelTerminationStrategy: PID 24190 died... 16:48:06.159066 run iperf3-srv_10.42.42.10(pid=24190): Terminated {rc=256} 16:48:06.205164 --- ParallelTerminationStrategy: PID 24191 died... 16:48:06.224518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24191): Terminated: ok {rc=0} 16:48:06.270599 --- ParallelTerminationStrategy: PID 24192 died... 16:48:06.290375 run iperf3-srv_10.42.42.10(pid=24192): Terminated {rc=256} 16:48:06.336442 --- ParallelTerminationStrategy: PID 24193 died... 16:48:06.355897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24193): Terminated: ok {rc=0} 16:48:06.402086 --- ParallelTerminationStrategy: PID 24194 died... 16:48:06.421697 run iperf3-srv_10.42.42.10(pid=24194): Terminated {rc=256} 16:48:06.467680 --- ParallelTerminationStrategy: PID 24197 died... 16:48:06.487194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24197): Terminated: ok {rc=0} 16:48:06.533386 --- ParallelTerminationStrategy: PID 24200 died... 16:48:06.552870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24200): Terminated: ok {rc=0} 16:48:06.599155 --- ParallelTerminationStrategy: PID 24203 died... 16:48:06.618639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24203): Terminated: ok {rc=0} 16:48:06.705770 bus /gobi_4: Setting Powered False 16:48:07.804668 bus /gobi_4: Setting Powered False 16:48:08.920392 bus /gobi_1: Setting Powered False 16:48:10.019358 bus /gobi_1: Setting Powered False 16:48:11.133426 bus /gobi_0: Setting Powered False 16:48:12.231105 bus /gobi_0: Setting Powered False 16:48:13.346354 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 16:48:14.448105 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:14.459727 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:48:14.508915 tst ping.py: using LAC 22392 16:48:14.626714 tst ping.py: using RAC 207 16:48:14.742083 tst ping.py: using CellId 22392 16:48:14.860516 tst ping.py: using BVCI 22393 16:48:14.967244 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:14.978296 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:14.989215 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:14.999998 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:15.011100 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:15.021838 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:15.032898 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:15.043747 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:48:15.157281 tst ping.py:19: start network... 16:48:15.357948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:15.816419 run create_hlr_db(pid=24205): Launched 16:48:15.973477 bus /gobi_6: Setting Powered False 16:48:17.074792 run create_hlr_db(pid=24205): Terminated: ok {rc=0} 16:48:17.567564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24207): Launched 16:48:17.886711 run osmo-hlr_10.42.42.2(pid=24208): Launched 16:48:18.008477 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:18.561528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24210): Launched 16:48:18.879563 run osmo-stp_10.42.42.5(pid=24211): Launched 16:48:19.000716 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:19.555320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24213): Launched 16:48:19.678073 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:19.947838 run patchelf(pid=24214): Launched 16:48:20.126143 run osmo-stp_10.42.42.5(pid=24211): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24211)] 16:48:20.261420 run osmo-stp_10.42.42.5(pid=24211): stdout: | (launched: 2022-12-09_16:48:18.820942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:20.399080 run osmo-stp_10.42.42.5(pid=24211): stderr: | [0;m[38;5;43m20221209164819012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164819012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164819013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164819013 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164819014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164819014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164819014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:20.536888 run osmo-stp_10.42.42.5(pid=24211): stdout: | (launched: 2022-12-09_16:48:18.820942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:20.667565 run osmo-stp_10.42.42.5(pid=24211): stderr: | [0;m[38;5;43m20221209164819012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164819012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164819013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164819013 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164819014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164819014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164819014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:20.822972 run patchelf(pid=24214): Terminating (SIGINT) 16:48:21.001034 run patchelf(pid=24214): Terminated: ok {rc=0} 16:48:21.129602 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24211): Process ended prematurely: osmo-stp_10.42.42.5(pid=24211) [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24211)] [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 16:48:21.139318 tst ping.py:22: Test FAILED (6.7 sec) 16:48:21.167991 run osmo-hlr_10.42.42.2(pid=24208): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24208)] 16:48:21.218180 run osmo-hlr_10.42.42.2(pid=24208): stdout: | (launched: 2022-12-09_16:48:17.828382) 16:48:21.270121 run osmo-hlr_10.42.42.2(pid=24208): stderr: | [0;m[1;31m20221209164818026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164818026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164818026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164818027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164818027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164818027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164818039 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164818047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164818047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164818047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:21.322461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24207): Terminating (SIGTERM) 16:48:21.364534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24210): Terminating (SIGTERM) 16:48:21.406462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24213): Terminating (SIGTERM) 16:48:21.448358 --- ParallelTerminationStrategy: PID 24207 died... 16:48:21.468423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24207): Terminated: ok {rc=0} 16:48:21.514907 --- ParallelTerminationStrategy: PID 24210 died... 16:48:21.534488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24210): Terminated: ok {rc=0} 16:48:21.580830 --- ParallelTerminationStrategy: PID 24213 died... 16:48:21.600659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24213): Terminated: ok {rc=0} 16:48:21.687583 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:48:22.775430 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:22.787264 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:48:22.837142 tst ping_idle_ping.py: using LAC 22393 16:48:22.955782 tst ping_idle_ping.py: using RAC 208 16:48:23.073568 tst ping_idle_ping.py: using CellId 22393 16:48:23.200538 tst ping_idle_ping.py: using BVCI 22394 16:48:23.317983 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:23.329567 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:23.340695 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:23.352408 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:23.363802 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:23.375161 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:23.387191 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:23.398661 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:48:23.514468 tst ping_idle_ping.py:24: start network... 16:48:23.731436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:24.227310 run create_hlr_db(pid=24215): Launched 16:48:24.348785 bus /gobi_6: Setting Powered False 16:48:25.411227 run create_hlr_db(pid=24215): Terminated: ok {rc=0} 16:48:25.838399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24217): Launched 16:48:26.137165 run osmo-hlr_10.42.42.2(pid=24218): Launched 16:48:26.251579 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:26.778041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24220): Launched 16:48:27.075617 run osmo-stp_10.42.42.5(pid=24221): Launched 16:48:27.189110 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:27.702484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24223): Launched 16:48:27.815697 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:28.066693 run patchelf(pid=24224): Launched 16:48:28.232489 run osmo-stp_10.42.42.5(pid=24221): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24221)] 16:48:28.359034 run osmo-stp_10.42.42.5(pid=24221): stdout: | (launched: 2022-12-09_16:48:27.020738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:28.486914 run osmo-stp_10.42.42.5(pid=24221): stderr: | [0;m[38;5;43m20221209164827192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164827192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164827192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164827193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164827193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164827193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164827193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:28.614629 run osmo-stp_10.42.42.5(pid=24221): stdout: | (launched: 2022-12-09_16:48:27.020738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:28.736243 run osmo-stp_10.42.42.5(pid=24221): stderr: | [0;m[38;5;43m20221209164827192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164827192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164827192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164827193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164827193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164827193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164827193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:28.880604 run patchelf(pid=24224): Terminating (SIGINT) 16:48:29.047265 run patchelf(pid=24224): Terminated: ok {rc=0} 16:48:29.167220 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24221): Process ended prematurely: osmo-stp_10.42.42.5(pid=24221) [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24221)] [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 16:48:29.176165 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 16:48:29.202839 run osmo-hlr_10.42.42.2(pid=24218): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24218)] 16:48:29.250083 run osmo-hlr_10.42.42.2(pid=24218): stdout: | (launched: 2022-12-09_16:48:26.082008) 16:48:29.299298 run osmo-hlr_10.42.42.2(pid=24218): stderr: | [0;m[1;31m20221209164826258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164826258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164826258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164826258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164826258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164826258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164826270 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164826279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164826279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164826279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:29.348641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24217): Terminating (SIGTERM) 16:48:29.388195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24220): Terminating (SIGTERM) 16:48:29.427788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24223): Terminating (SIGTERM) 16:48:29.467585 --- ParallelTerminationStrategy: PID 24217 died... 16:48:29.486619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24217): Terminated: ok {rc=0} 16:48:29.530657 --- ParallelTerminationStrategy: PID 24220 died... 16:48:29.549444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24220): Terminated: ok {rc=0} 16:48:29.593575 --- ParallelTerminationStrategy: PID 24223 died... 16:48:29.612375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24223): Terminated: ok {rc=0} 16:48:29.696153 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:48:31.017298 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:48:31.024557 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:48:31.063661 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:48:31.105641 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:48:31.197394 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:48:31.230586 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:48:31.270506 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:48:31.863865 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:48:31.939469 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:31.955898 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:48:32.039420 tst cs_paging_gprs_active.py: using LAC 22394 16:48:32.175885 tst cs_paging_gprs_active.py: using RAC 209 16:48:32.322320 tst cs_paging_gprs_active.py: using CellId 22394 16:48:32.439913 tst cs_paging_gprs_active.py: using BVCI 22395 16:48:32.549586 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.562447 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.573431 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.584189 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.595235 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.606111 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.616849 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.627905 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.638903 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:32.758200 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:32.878685 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:48:33.098324 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:33.425591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24228): Launched 16:48:33.707903 run iperf3-srv_10.42.42.10(pid=24229): Launched 16:48:33.830136 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:48:34.049759 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:34.376024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24230): Launched 16:48:34.659046 run iperf3-srv_10.42.42.10(pid=24231): Launched 16:48:34.780605 tst cs_paging_gprs_active.py:38: start network... 16:48:34.999053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:35.502443 run create_hlr_db(pid=24232): Launched 16:48:35.626602 bus /gobi_6: Setting Powered False 16:48:36.690227 run create_hlr_db(pid=24232): Terminated: ok {rc=0} 16:48:37.123127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24234): Launched 16:48:37.427132 run osmo-hlr_10.42.42.2(pid=24235): Launched 16:48:37.542509 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:38.064006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24237): Launched 16:48:38.367751 run osmo-stp_10.42.42.5(pid=24238): Launched 16:48:38.483085 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:39.005949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24240): Launched 16:48:39.122792 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:39.380798 run patchelf(pid=24241): Launched 16:48:39.550274 run osmo-stp_10.42.42.5(pid=24238): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24238)] 16:48:39.679128 run osmo-stp_10.42.42.5(pid=24238): stdout: | (launched: 2022-12-09_16:48:38.311334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:39.809345 run osmo-stp_10.42.42.5(pid=24238): stderr: | [0;m[38;5;43m20221209164838484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164838484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164838484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164838484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164838485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164838485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164838485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:39.939916 run osmo-stp_10.42.42.5(pid=24238): stdout: | (launched: 2022-12-09_16:48:38.311334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:40.063946 run osmo-stp_10.42.42.5(pid=24238): stderr: | [0;m[38;5;43m20221209164838484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164838484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164838484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164838484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164838485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164838485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164838485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:40.211601 run patchelf(pid=24241): Terminating (SIGINT) 16:48:40.382199 run patchelf(pid=24241): Terminated: ok {rc=0} 16:48:40.505357 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24238): Process ended prematurely: osmo-stp_10.42.42.5(pid=24238) [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24238)] [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:48:40.514771 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 16:48:40.541818 run osmo-hlr_10.42.42.2(pid=24235): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24235)] 16:48:40.589304 run osmo-hlr_10.42.42.2(pid=24235): stdout: | (launched: 2022-12-09_16:48:37.371402) 16:48:40.638385 run osmo-hlr_10.42.42.2(pid=24235): stderr: | [0;m[1;31m20221209164837549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164837549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164837549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164837549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164837549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164837549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164837565 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164837574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164837574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164837574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:40.687866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24228): Terminating (SIGTERM) 16:48:40.727526 run iperf3-srv_10.42.42.10(pid=24229): Terminating (SIGTERM) 16:48:40.767238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24230): Terminating (SIGTERM) 16:48:40.807019 run iperf3-srv_10.42.42.10(pid=24231): Terminating (SIGTERM) 16:48:40.846725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24234): Terminating (SIGTERM) 16:48:40.886445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24237): Terminating (SIGTERM) 16:48:40.926339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24240): Terminating (SIGTERM) 16:48:40.966291 --- ParallelTerminationStrategy: PID 24228 died... 16:48:40.985557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24228): Terminated: ok {rc=0} 16:48:41.029752 --- ParallelTerminationStrategy: PID 24229 died... 16:48:41.048489 run iperf3-srv_10.42.42.10(pid=24229): Terminated {rc=256} 16:48:41.092404 --- ParallelTerminationStrategy: PID 24230 died... 16:48:41.111193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24230): Terminated: ok {rc=0} 16:48:41.154906 --- ParallelTerminationStrategy: PID 24231 died... 16:48:41.173432 run iperf3-srv_10.42.42.10(pid=24231): Terminated {rc=256} 16:48:41.217053 --- ParallelTerminationStrategy: PID 24234 died... 16:48:41.235771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24234): Terminated: ok {rc=0} 16:48:41.279439 --- ParallelTerminationStrategy: PID 24237 died... 16:48:41.298183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24237): Terminated: ok {rc=0} 16:48:41.341923 --- ParallelTerminationStrategy: PID 24240 died... 16:48:41.360333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24240): Terminated: ok {rc=0} 16:48:41.443619 bus /gobi_0: Setting Powered False 16:48:42.541608 bus /gobi_0: Setting Powered False 16:48:43.656810 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:48:44.805114 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:44.817281 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:48:44.889382 tst iperf3.py: using LAC 22395 16:48:45.017350 tst iperf3.py: using RAC 210 16:48:45.136745 tst iperf3.py: using CellId 22395 16:48:45.257412 tst iperf3.py: using BVCI 22396 16:48:45.366638 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:45.377825 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:45.388788 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:45.399742 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:45.410723 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:45.421717 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:45.432568 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:45.443309 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:45.454241 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:45.571998 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:48:45.791754 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:46.150763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24242): Launched 16:48:46.457702 run iperf3-srv_10.42.42.10(pid=24243): Launched 16:48:46.591533 tst iperf3.py:8: start network... 16:48:46.815645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:47.325837 run create_hlr_db(pid=24244): Launched 16:48:47.450508 bus /gobi_6: Setting Powered False 16:48:48.514764 run create_hlr_db(pid=24244): Terminated: ok {rc=0} 16:48:48.947144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24246): Launched 16:48:49.251851 run osmo-hlr_10.42.42.2(pid=24247): Launched 16:48:49.367144 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:49.893137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24249): Launched 16:48:50.195651 run osmo-stp_10.42.42.5(pid=24250): Launched 16:48:50.311122 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:50.830604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24252): Launched 16:48:50.946884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:51.202535 run patchelf(pid=24253): Launched 16:48:51.371160 run osmo-stp_10.42.42.5(pid=24250): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24250)] 16:48:51.499648 run osmo-stp_10.42.42.5(pid=24250): stdout: | (launched: 2022-12-09_16:48:50.140261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:51.629251 run osmo-stp_10.42.42.5(pid=24250): stderr: | [0;m[38;5;43m20221209164850313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164850313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164850314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164850314 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164850314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164850314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164850315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:51.758776 run osmo-stp_10.42.42.5(pid=24250): stdout: | (launched: 2022-12-09_16:48:50.140261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:51.881920 run osmo-stp_10.42.42.5(pid=24250): stderr: | [0;m[38;5;43m20221209164850313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164850313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164850314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164850314 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164850314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164850314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164850315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:52.028406 run patchelf(pid=24253): Terminating (SIGINT) 16:48:52.198148 run patchelf(pid=24253): Terminated: ok {rc=0} 16:48:52.321138 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24250): Process ended prematurely: osmo-stp_10.42.42.5(pid=24250) [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24250)] [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 16:48:52.330497 tst iperf3.py:8: Test FAILED (7.6 sec) 16:48:52.357414 run osmo-hlr_10.42.42.2(pid=24247): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24247)] 16:48:52.404429 run osmo-hlr_10.42.42.2(pid=24247): stdout: | (launched: 2022-12-09_16:48:49.195924) 16:48:52.453227 run osmo-hlr_10.42.42.2(pid=24247): stderr: | [0;m[1;31m20221209164849374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164849374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164849374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164849374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164849374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164849374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164849386 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164849395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164849395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164849395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:52.502571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24242): Terminating (SIGTERM) 16:48:52.541572 run iperf3-srv_10.42.42.10(pid=24243): Terminating (SIGTERM) 16:48:52.580582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24246): Terminating (SIGTERM) 16:48:52.619911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24249): Terminating (SIGTERM) 16:48:52.659177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24252): Terminating (SIGTERM) 16:48:52.698746 --- ParallelTerminationStrategy: PID 24242 died... 16:48:52.717719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24242): Terminated: ok {rc=0} 16:48:52.761622 --- ParallelTerminationStrategy: PID 24243 died... 16:48:52.779839 run iperf3-srv_10.42.42.10(pid=24243): Terminated {rc=256} 16:48:52.823424 --- ParallelTerminationStrategy: PID 24246 died... 16:48:52.841913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24246): Terminated: ok {rc=0} 16:48:52.885553 --- ParallelTerminationStrategy: PID 24249 died... 16:48:52.904085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24249): Terminated: ok {rc=0} 16:48:52.947970 --- ParallelTerminationStrategy: PID 24252 died... 16:48:52.966427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24252): Terminated: ok {rc=0} 16:48:53.049787 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:48:54.196516 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:54.208769 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:48:54.278755 tst iperf3m4.py: using LAC 22396 16:48:54.406945 tst iperf3m4.py: using RAC 211 16:48:54.527934 tst iperf3m4.py: using CellId 22396 16:48:54.646615 tst iperf3m4.py: using BVCI 22397 16:48:54.758005 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:54.768894 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:54.779841 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:54.791286 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:54.802540 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:54.813862 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:54.825399 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:54.836562 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:54.847953 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:54.966686 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:55.087190 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:55.208648 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:55.332628 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:48:55.537604 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:55.842191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24254): Launched 16:48:56.107202 run iperf3-srv_10.42.42.10(pid=24255): Launched 16:48:56.220904 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:48:56.424105 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:56.728463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24256): Launched 16:48:56.992226 run iperf3-srv_10.42.42.10(pid=24257): Launched 16:48:57.106116 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:48:57.309917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:57.615081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24258): Launched 16:48:57.879061 run iperf3-srv_10.42.42.10(pid=24259): Launched 16:48:57.992229 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:48:58.195497 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:58.499430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24260): Launched 16:48:58.764039 run iperf3-srv_10.42.42.10(pid=24261): Launched 16:48:58.877350 tst iperf3m4.py:8: start network... 16:48:59.080080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:59.548166 run create_hlr_db(pid=24262): Launched 16:48:59.672064 bus /gobi_6: Setting Powered False 16:49:00.731779 run create_hlr_db(pid=24262): Terminated: ok {rc=0} 16:49:01.219985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24264): Launched 16:49:01.560561 run osmo-hlr_10.42.42.2(pid=24265): Launched 16:49:01.787308 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:02.444846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24267): Launched 16:49:02.749625 run osmo-stp_10.42.42.5(pid=24268): Launched 16:49:02.863430 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:03.383713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24270): Launched 16:49:03.499279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:03.755548 run patchelf(pid=24271): Launched 16:49:03.923535 run osmo-stp_10.42.42.5(pid=24268): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24268)] 16:49:04.050907 run osmo-stp_10.42.42.5(pid=24268): stdout: | (launched: 2022-12-09_16:49:02.693844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:04.180001 run osmo-stp_10.42.42.5(pid=24268): stderr: | [0;m[38;5;43m20221209164902864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164902864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164902864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164902865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164902865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164902865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164902865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:04.309356 run osmo-stp_10.42.42.5(pid=24268): stdout: | (launched: 2022-12-09_16:49:02.693844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:04.432411 run osmo-stp_10.42.42.5(pid=24268): stderr: | [0;m[38;5;43m20221209164902864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164902864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164902864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164902865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164902865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164902865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164902865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:04.578158 run patchelf(pid=24271): Terminating (SIGINT) 16:49:04.747018 run patchelf(pid=24271): Terminated: ok {rc=0} 16:49:04.868818 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24268): Process ended prematurely: osmo-stp_10.42.42.5(pid=24268) [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24268)] [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:49:04.878412 tst iperf3m4.py:8: Test FAILED (10.7 sec) 16:49:04.905689 run osmo-hlr_10.42.42.2(pid=24265): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24265)] 16:49:04.952728 run osmo-hlr_10.42.42.2(pid=24265): stdout: | (launched: 2022-12-09_16:49:01.496695) 16:49:05.001359 run osmo-hlr_10.42.42.2(pid=24265): stderr: | [0;m[1;31m20221209164901832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164901832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164901832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164901832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164901832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164901832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164901857 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164901879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164901880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164901880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:05.050486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24254): Terminating (SIGTERM) 16:49:05.089587 run iperf3-srv_10.42.42.10(pid=24255): Terminating (SIGTERM) 16:49:05.128801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24256): Terminating (SIGTERM) 16:49:05.168005 run iperf3-srv_10.42.42.10(pid=24257): Terminating (SIGTERM) 16:49:05.207027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24258): Terminating (SIGTERM) 16:49:05.246229 run iperf3-srv_10.42.42.10(pid=24259): Terminating (SIGTERM) 16:49:05.285865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24260): Terminating (SIGTERM) 16:49:05.325273 run iperf3-srv_10.42.42.10(pid=24261): Terminating (SIGTERM) 16:49:05.364652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24264): Terminating (SIGTERM) 16:49:05.403626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24267): Terminating (SIGTERM) 16:49:05.442676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24270): Terminating (SIGTERM) 16:49:05.482105 --- ParallelTerminationStrategy: PID 24254 died... 16:49:05.501070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24254): Terminated: ok {rc=0} 16:49:05.544798 --- ParallelTerminationStrategy: PID 24255 died... 16:49:05.563396 run iperf3-srv_10.42.42.10(pid=24255): Terminated {rc=256} 16:49:05.607206 --- ParallelTerminationStrategy: PID 24256 died... 16:49:05.625791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24256): Terminated: ok {rc=0} 16:49:05.669755 --- ParallelTerminationStrategy: PID 24257 died... 16:49:05.688356 run iperf3-srv_10.42.42.10(pid=24257): Terminated {rc=256} 16:49:05.731599 --- ParallelTerminationStrategy: PID 24258 died... 16:49:05.750208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24258): Terminated: ok {rc=0} 16:49:05.794017 --- ParallelTerminationStrategy: PID 24259 died... 16:49:05.812763 run iperf3-srv_10.42.42.10(pid=24259): Terminated {rc=256} 16:49:05.856444 --- ParallelTerminationStrategy: PID 24260 died... 16:49:05.875058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24260): Terminated: ok {rc=0} 16:49:05.918833 --- ParallelTerminationStrategy: PID 24261 died... 16:49:05.937353 run iperf3-srv_10.42.42.10(pid=24261): Terminated {rc=256} 16:49:05.980473 --- ParallelTerminationStrategy: PID 24264 died... 16:49:05.999022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24264): Terminated: ok {rc=0} 16:49:06.042195 --- ParallelTerminationStrategy: PID 24267 died... 16:49:06.060637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24267): Terminated: ok {rc=0} 16:49:06.104427 --- ParallelTerminationStrategy: PID 24270 died... 16:49:06.123210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24270): Terminated: ok {rc=0} 16:49:06.209985 bus /gobi_4: Setting Powered False 16:49:07.309353 bus /gobi_4: Setting Powered False 16:49:08.423697 bus /gobi_1: Setting Powered False 16:49:09.522725 bus /gobi_1: Setting Powered False 16:49:10.638234 bus /gobi_0: Setting Powered False 16:49:11.736154 bus /gobi_0: Setting Powered False 16:49:12.851152 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:49:13.953478 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:13.965208 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:49:14.037728 tst ping.py: using LAC 22397 16:49:14.154606 tst ping.py: using RAC 212 16:49:14.269600 tst ping.py: using CellId 22397 16:49:14.385074 tst ping.py: using BVCI 22398 16:49:14.492302 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:14.503420 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:14.514231 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:14.525630 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:14.536886 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:14.548189 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:14.559603 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:14.570949 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:49:14.689990 tst ping.py:19: start network... 16:49:14.906792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:15.401039 run create_hlr_db(pid=24274): Launched 16:49:15.523239 bus /gobi_6: Setting Powered False 16:49:16.589129 run create_hlr_db(pid=24274): Terminated: ok {rc=0} 16:49:17.071242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24276): Launched 16:49:17.377321 run osmo-hlr_10.42.42.2(pid=24277): Launched 16:49:17.492717 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:18.009249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24279): Launched 16:49:18.305718 run osmo-stp_10.42.42.5(pid=24280): Launched 16:49:18.417860 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:18.929468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24282): Launched 16:49:19.043183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:19.294507 run patchelf(pid=24283): Launched 16:49:19.461143 run osmo-stp_10.42.42.5(pid=24280): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24280)] 16:49:19.587108 run osmo-stp_10.42.42.5(pid=24280): stdout: | (launched: 2022-12-09_16:49:18.250963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:19.716013 run osmo-stp_10.42.42.5(pid=24280): stderr: | [0;m[38;5;43m20221209164918423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164918423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164918423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164918424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164918424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164918424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164918424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:19.844239 run osmo-stp_10.42.42.5(pid=24280): stdout: | (launched: 2022-12-09_16:49:18.250963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:19.966479 run osmo-stp_10.42.42.5(pid=24280): stderr: | [0;m[38;5;43m20221209164918423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164918423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164918423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164918424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164918424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164918424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164918424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:20.111013 run patchelf(pid=24283): Terminating (SIGINT) 16:49:20.278053 run patchelf(pid=24283): Terminated: ok {rc=0} 16:49:20.398573 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24280): Process ended prematurely: osmo-stp_10.42.42.5(pid=24280) [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24280)] [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 16:49:20.407332 tst ping.py:22: Test FAILED (6.4 sec) 16:49:20.433988 run osmo-hlr_10.42.42.2(pid=24277): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24277)] 16:49:20.481254 run osmo-hlr_10.42.42.2(pid=24277): stdout: | (launched: 2022-12-09_16:49:17.322339) 16:49:20.530385 run osmo-hlr_10.42.42.2(pid=24277): stderr: | [0;m[1;31m20221209164917499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164917499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164917499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164917499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164917499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164917499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164917511 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164917519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164917520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164917520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:20.579576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24276): Terminating (SIGTERM) 16:49:20.619114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24279): Terminating (SIGTERM) 16:49:20.658670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24282): Terminating (SIGTERM) 16:49:20.698557 --- ParallelTerminationStrategy: PID 24276 died... 16:49:20.717579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24276): Terminated: ok {rc=0} 16:49:20.761562 --- ParallelTerminationStrategy: PID 24279 died... 16:49:20.780021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24279): Terminated: ok {rc=0} 16:49:20.824044 --- ParallelTerminationStrategy: PID 24282 died... 16:49:20.842836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24282): Terminated: ok {rc=0} 16:49:20.928215 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:49:22.017291 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:22.029604 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:49:22.099987 tst ping_idle_ping.py: using LAC 22398 16:49:22.227650 tst ping_idle_ping.py: using RAC 213 16:49:22.352504 tst ping_idle_ping.py: using CellId 22398 16:49:22.479457 tst ping_idle_ping.py: using BVCI 22399 16:49:22.589786 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:22.601037 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:22.612144 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:22.623345 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:22.634421 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:22.645509 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:22.656466 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:22.667412 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:49:22.785218 tst ping_idle_ping.py:24: start network... 16:49:23.004578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:23.504161 run create_hlr_db(pid=24284): Launched 16:49:23.627164 bus /gobi_6: Setting Powered False 16:49:24.690958 run create_hlr_db(pid=24284): Terminated: ok {rc=0} 16:49:25.118046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24286): Launched 16:49:25.417172 run osmo-hlr_10.42.42.2(pid=24287): Launched 16:49:25.531280 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:26.049928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24289): Launched 16:49:26.348011 run osmo-stp_10.42.42.5(pid=24290): Launched 16:49:26.462107 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:26.994419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24292): Launched 16:49:27.108748 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:27.362339 run patchelf(pid=24293): Launched 16:49:27.529714 run osmo-stp_10.42.42.5(pid=24290): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24290)] 16:49:27.656262 run osmo-stp_10.42.42.5(pid=24290): stdout: | (launched: 2022-12-09_16:49:26.292539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:27.785876 run osmo-stp_10.42.42.5(pid=24290): stderr: | [0;m[38;5;43m20221209164926464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164926464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164926464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164926465 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164926465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164926465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164926465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:27.914837 run osmo-stp_10.42.42.5(pid=24290): stdout: | (launched: 2022-12-09_16:49:26.292539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:28.037135 run osmo-stp_10.42.42.5(pid=24290): stderr: | [0;m[38;5;43m20221209164926464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164926464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164926464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164926465 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164926465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164926465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164926465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:28.182335 run patchelf(pid=24293): Terminating (SIGINT) 16:49:28.350135 run patchelf(pid=24293): Terminated: ok {rc=0} 16:49:28.470761 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24290): Process ended prematurely: osmo-stp_10.42.42.5(pid=24290) [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24290)] [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:49:28.479518 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:49:28.506317 run osmo-hlr_10.42.42.2(pid=24287): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24287)] 16:49:28.553511 run osmo-hlr_10.42.42.2(pid=24287): stdout: | (launched: 2022-12-09_16:49:25.362138) 16:49:28.602591 run osmo-hlr_10.42.42.2(pid=24287): stderr: | [0;m[1;31m20221209164925537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164925537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164925537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164925537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164925537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164925537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164925550 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164925559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164925559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164925559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:28.651939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24286): Terminating (SIGTERM) 16:49:28.691430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24289): Terminating (SIGTERM) 16:49:28.730829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24292): Terminating (SIGTERM) 16:49:28.770650 --- ParallelTerminationStrategy: PID 24286 died... 16:49:28.789386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24286): Terminated: ok {rc=0} 16:49:28.833094 --- ParallelTerminationStrategy: PID 24289 died... 16:49:28.851586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24289): Terminated: ok {rc=0} 16:49:28.895272 --- ParallelTerminationStrategy: PID 24292 died... 16:49:28.913866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24292): Terminated: ok {rc=0} 16:49:28.996230 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:49:30.307632 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:49:30.315883 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:49:30.350453 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 16:49:30.390153 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 16:49:30.478047 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:49:30.510859 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 16:49:30.550151 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 16:49:31.213070 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 16:49:31.269931 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:31.282867 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:49:31.336337 tst cs_paging_gprs_active.py: using LAC 22399 16:49:31.477766 tst cs_paging_gprs_active.py: using RAC 214 16:49:31.631377 tst cs_paging_gprs_active.py: using CellId 22399 16:49:31.794051 tst cs_paging_gprs_active.py: using BVCI 22400 16:49:31.929745 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:31.941814 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:31.953715 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:31.967155 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:31.978978 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:31.991580 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:32.004932 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:32.017873 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:32.030435 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:32.152135 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:32.283576 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:49:32.485593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:32.786600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24298): Launched 16:49:33.047390 run iperf3-srv_10.42.42.10(pid=24299): Launched 16:49:33.159982 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:49:33.359998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:33.659614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24300): Launched 16:49:33.919637 run iperf3-srv_10.42.42.10(pid=24301): Launched 16:49:34.032223 tst cs_paging_gprs_active.py:38: start network... 16:49:34.231407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:34.694738 run create_hlr_db(pid=24302): Launched 16:49:34.818388 bus /gobi_6: Setting Powered False 16:49:35.878504 run create_hlr_db(pid=24302): Terminated: ok {rc=0} 16:49:36.296075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24304): Launched 16:49:36.594966 run osmo-hlr_10.42.42.2(pid=24305): Launched 16:49:36.707997 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:37.220253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24307): Launched 16:49:37.520315 run osmo-stp_10.42.42.5(pid=24308): Launched 16:49:37.634150 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:38.151114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24310): Launched 16:49:38.265761 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:38.518632 run patchelf(pid=24311): Launched 16:49:38.685624 run osmo-stp_10.42.42.5(pid=24308): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24308)] 16:49:38.812264 run osmo-stp_10.42.42.5(pid=24308): stdout: | (launched: 2022-12-09_16:49:37.465388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:38.940541 run osmo-stp_10.42.42.5(pid=24308): stderr: | [0;m[38;5;43m20221209164937635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164937636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164937636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164937636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164937637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164937637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164937637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:39.069629 run osmo-stp_10.42.42.5(pid=24308): stdout: | (launched: 2022-12-09_16:49:37.465388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:39.192344 run osmo-stp_10.42.42.5(pid=24308): stderr: | [0;m[38;5;43m20221209164937635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164937636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164937636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164937636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164937637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164937637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164937637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:39.338014 run patchelf(pid=24311): Terminating (SIGINT) 16:49:39.506683 run patchelf(pid=24311): Terminated: ok {rc=0} 16:49:39.628109 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24308): Process ended prematurely: osmo-stp_10.42.42.5(pid=24308) [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24308)] [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 16:49:39.637645 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 16:49:39.664489 run osmo-hlr_10.42.42.2(pid=24305): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24305)] 16:49:39.711699 run osmo-hlr_10.42.42.2(pid=24305): stdout: | (launched: 2022-12-09_16:49:36.540279) 16:49:39.760678 run osmo-hlr_10.42.42.2(pid=24305): stderr: | [0;m[1;31m20221209164936716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164936716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164936716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164936716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164936716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164936716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164936728 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164936736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164936737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164936737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:39.810073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24298): Terminating (SIGTERM) 16:49:39.849517 run iperf3-srv_10.42.42.10(pid=24299): Terminating (SIGTERM) 16:49:39.888818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24300): Terminating (SIGTERM) 16:49:39.927989 run iperf3-srv_10.42.42.10(pid=24301): Terminating (SIGTERM) 16:49:39.966977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24304): Terminating (SIGTERM) 16:49:40.006179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24307): Terminating (SIGTERM) 16:49:40.045246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24310): Terminating (SIGTERM) 16:49:40.085224 --- ParallelTerminationStrategy: PID 24298 died... 16:49:40.103899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24298): Terminated: ok {rc=0} 16:49:40.147470 --- ParallelTerminationStrategy: PID 24299 died... 16:49:40.165768 run iperf3-srv_10.42.42.10(pid=24299): Terminated {rc=256} 16:49:40.208740 --- ParallelTerminationStrategy: PID 24300 died... 16:49:40.227030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24300): Terminated: ok {rc=0} 16:49:40.270056 --- ParallelTerminationStrategy: PID 24301 died... 16:49:40.288266 run iperf3-srv_10.42.42.10(pid=24301): Terminated {rc=256} 16:49:40.331432 --- ParallelTerminationStrategy: PID 24304 died... 16:49:40.349753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24304): Terminated: ok {rc=0} 16:49:40.392764 --- ParallelTerminationStrategy: PID 24307 died... 16:49:40.411046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24307): Terminated: ok {rc=0} 16:49:40.454369 --- ParallelTerminationStrategy: PID 24310 died... 16:49:40.473138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24310): Terminated: ok {rc=0} 16:49:40.557340 bus /gobi_0: Setting Powered False 16:49:41.655892 bus /gobi_0: Setting Powered False 16:49:42.770173 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 16:49:43.916064 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:43.928269 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:49:43.978310 tst iperf3.py: using LAC 22400 16:49:44.095365 tst iperf3.py: using RAC 215 16:49:44.217288 tst iperf3.py: using CellId 22400 16:49:44.335755 tst iperf3.py: using BVCI 22401 16:49:44.443755 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:44.455188 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:44.466414 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:44.477588 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:44.488634 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:44.499755 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:44.510946 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:44.521927 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:44.533197 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:44.650162 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:49:44.851216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:45.151501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24312): Launched 16:49:45.411798 run iperf3-srv_10.42.42.10(pid=24313): Launched 16:49:45.523755 tst iperf3.py:8: start network... 16:49:45.723251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:46.214689 run create_hlr_db(pid=24314): Launched 16:49:46.364363 bus /gobi_6: Setting Powered False 16:49:47.424008 run create_hlr_db(pid=24314): Terminated: ok {rc=0} 16:49:47.841662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24316): Launched 16:49:48.141297 run osmo-hlr_10.42.42.2(pid=24317): Launched 16:49:48.255877 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:48.786575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24319): Launched 16:49:49.086525 run osmo-stp_10.42.42.5(pid=24320): Launched 16:49:49.200745 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:49.716207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24322): Launched 16:49:49.831282 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:50.085083 run patchelf(pid=24323): Launched 16:49:50.251997 run osmo-stp_10.42.42.5(pid=24320): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24320)] 16:49:50.379846 run osmo-stp_10.42.42.5(pid=24320): stdout: | (launched: 2022-12-09_16:49:49.031762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:50.508533 run osmo-stp_10.42.42.5(pid=24320): stderr: | [0;m[38;5;43m20221209164949201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164949201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164949201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164949202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164949202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164949202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164949202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:50.637195 run osmo-stp_10.42.42.5(pid=24320): stdout: | (launched: 2022-12-09_16:49:49.031762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:50.759541 run osmo-stp_10.42.42.5(pid=24320): stderr: | [0;m[38;5;43m20221209164949201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209164949201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209164949201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209164949202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209164949202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209164949202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209164949202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:50.904939 run patchelf(pid=24323): Terminating (SIGINT) 16:49:51.072539 run patchelf(pid=24323): Terminated: ok {rc=0} 16:49:51.193944 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24320): Process ended prematurely: osmo-stp_10.42.42.5(pid=24320) [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24320)] [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 16:49:51.203365 tst iperf3.py:8: Test FAILED (7.3 sec) 16:49:51.230338 run osmo-hlr_10.42.42.2(pid=24317): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24317)] 16:49:51.277723 run osmo-hlr_10.42.42.2(pid=24317): stdout: | (launched: 2022-12-09_16:49:48.086586) 16:49:51.326835 run osmo-hlr_10.42.42.2(pid=24317): stderr: | [0;m[1;31m20221209164948264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209164948264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209164948264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209164948265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209164948265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209164948265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209164948277 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209164948287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209164948287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209164948287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:51.376441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24312): Terminating (SIGTERM) 16:49:51.415837 run iperf3-srv_10.42.42.10(pid=24313): Terminating (SIGTERM) 16:49:51.454955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24316): Terminating (SIGTERM) 16:49:51.494307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24319): Terminating (SIGTERM) 16:49:51.533666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24322): Terminating (SIGTERM) 16:49:51.573049 --- ParallelTerminationStrategy: PID 24312 died... 16:49:51.591745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24312): Terminated: ok {rc=0} 16:49:51.635000 --- ParallelTerminationStrategy: PID 24313 died... 16:49:51.653414 run iperf3-srv_10.42.42.10(pid=24313): Terminated {rc=256} 16:49:51.696541 --- ParallelTerminationStrategy: PID 24316 died... 16:49:51.714915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24316): Terminated: ok {rc=0} 16:49:51.758793 --- ParallelTerminationStrategy: PID 24319 died... 16:49:51.777122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24319): Terminated: ok {rc=0} 16:49:51.820494 --- ParallelTerminationStrategy: PID 24322 died... 16:49:51.838836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24322): Terminated: ok {rc=0} 16:49:51.921023 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 16:49:53.069557 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:53.082287 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:49:53.137261 tst iperf3m4.py: using LAC 22401 16:49:53.262528 tst iperf3m4.py: using RAC 216 16:49:53.387464 tst iperf3m4.py: using CellId 22401 16:49:53.513296 tst iperf3m4.py: using BVCI 22402 16:49:53.630876 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:53.642783 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:53.654605 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:53.666698 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:53.678714 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:53.690542 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:53.702682 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:53.715180 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:49:53.727492 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:53.843913 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:53.965257 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:54.083075 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:49:54.198236 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:49:54.402048 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:54.703863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24324): Launched 16:49:54.966301 run iperf3-srv_10.42.42.10(pid=24325): Launched 16:49:55.078950 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:49:55.280095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:55.581435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24326): Launched 16:49:55.842160 run iperf3-srv_10.42.42.10(pid=24327): Launched 16:49:55.954701 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:49:56.157192 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:56.458779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24328): Launched 16:49:56.720154 run iperf3-srv_10.42.42.10(pid=24329): Launched 16:49:56.832335 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:49:57.033326 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:57.337821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24330): Launched 16:49:57.598777 run iperf3-srv_10.42.42.10(pid=24331): Launched 16:49:57.710500 tst iperf3m4.py:8: start network... 16:49:57.910938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:58.373749 run create_hlr_db(pid=24332): Launched 16:49:58.496323 bus /gobi_6: Setting Powered False 16:49:59.555014 run create_hlr_db(pid=24332): Terminated: ok {rc=0} 16:49:59.995369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24334): Launched 16:50:00.316781 run osmo-hlr_10.42.42.2(pid=24335): Launched 16:50:00.439517 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:01.025870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24337): Launched 16:50:01.365761 run osmo-stp_10.42.42.5(pid=24341): Launched 16:50:01.538774 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:02.197767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24343): Launched 16:50:02.327095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:02.602715 run patchelf(pid=24344): Launched 16:50:02.783248 run osmo-stp_10.42.42.5(pid=24341): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24341)] 16:50:02.920410 run osmo-stp_10.42.42.5(pid=24341): stdout: | (launched: 2022-12-09_16:50:01.303692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:03.058960 run osmo-stp_10.42.42.5(pid=24341): stderr: | [0;m[38;5;43m20221209165001626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165001626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165001626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165001626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165001627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165001627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165001627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:03.197955 run osmo-stp_10.42.42.5(pid=24341): stdout: | (launched: 2022-12-09_16:50:01.303692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:03.330409 run osmo-stp_10.42.42.5(pid=24341): stderr: | [0;m[38;5;43m20221209165001626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165001626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165001626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165001626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165001627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165001627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165001627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:03.487718 run patchelf(pid=24344): Terminating (SIGINT) 16:50:03.668187 run patchelf(pid=24344): Terminated: ok {rc=0} 16:50:03.799259 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24341): Process ended prematurely: osmo-stp_10.42.42.5(pid=24341) [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24341)] [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 16:50:03.809463 tst iperf3m4.py:8: Test FAILED (10.8 sec) 16:50:03.839706 run osmo-hlr_10.42.42.2(pid=24335): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24335)] 16:50:03.890371 run osmo-hlr_10.42.42.2(pid=24335): stdout: | (launched: 2022-12-09_16:50:00.258631) 16:50:03.942649 run osmo-hlr_10.42.42.2(pid=24335): stderr: | [0;m[1;31m20221209165000456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165000456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165000456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165000456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165000456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165000456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165000468 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165000476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165000476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165000477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:03.995580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24324): Terminating (SIGTERM) 16:50:04.037925 run iperf3-srv_10.42.42.10(pid=24325): Terminating (SIGTERM) 16:50:04.080470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24326): Terminating (SIGTERM) 16:50:04.123452 run iperf3-srv_10.42.42.10(pid=24327): Terminating (SIGTERM) 16:50:04.165680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24328): Terminating (SIGTERM) 16:50:04.208206 run iperf3-srv_10.42.42.10(pid=24329): Terminating (SIGTERM) 16:50:04.250431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24330): Terminating (SIGTERM) 16:50:04.292367 run iperf3-srv_10.42.42.10(pid=24331): Terminating (SIGTERM) 16:50:04.334089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24334): Terminating (SIGTERM) 16:50:04.376290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24337): Terminating (SIGTERM) 16:50:04.418271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24343): Terminating (SIGTERM) 16:50:04.460441 --- ParallelTerminationStrategy: PID 24324 died... 16:50:04.479772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24324): Terminated: ok {rc=0} 16:50:04.526334 --- ParallelTerminationStrategy: PID 24325 died... 16:50:04.545717 run iperf3-srv_10.42.42.10(pid=24325): Terminated {rc=256} 16:50:04.591807 --- ParallelTerminationStrategy: PID 24326 died... 16:50:04.611259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24326): Terminated: ok {rc=0} 16:50:04.657572 --- ParallelTerminationStrategy: PID 24327 died... 16:50:04.677048 run iperf3-srv_10.42.42.10(pid=24327): Terminated {rc=256} 16:50:04.724709 --- ParallelTerminationStrategy: PID 24328 died... 16:50:04.744063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24328): Terminated: ok {rc=0} 16:50:04.790084 --- ParallelTerminationStrategy: PID 24329 died... 16:50:04.809507 run iperf3-srv_10.42.42.10(pid=24329): Terminated {rc=256} 16:50:04.856043 --- ParallelTerminationStrategy: PID 24330 died... 16:50:04.875477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24330): Terminated: ok {rc=0} 16:50:04.922088 --- ParallelTerminationStrategy: PID 24331 died... 16:50:04.941445 run iperf3-srv_10.42.42.10(pid=24331): Terminated {rc=256} 16:50:04.987999 --- ParallelTerminationStrategy: PID 24334 died... 16:50:05.007259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24334): Terminated: ok {rc=0} 16:50:05.053575 --- ParallelTerminationStrategy: PID 24337 died... 16:50:05.072995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24337): Terminated: ok {rc=0} 16:50:05.119514 --- ParallelTerminationStrategy: PID 24343 died... 16:50:05.138953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24343): Terminated: ok {rc=0} 16:50:05.226519 bus /gobi_4: Setting Powered False 16:50:06.325474 bus /gobi_4: Setting Powered False 16:50:07.441594 bus /gobi_1: Setting Powered False 16:50:08.536280 bus /gobi_1: Setting Powered False 16:50:09.650861 bus /gobi_0: Setting Powered False 16:50:10.752813 bus /gobi_0: Setting Powered False 16:50:11.868709 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 16:50:12.970304 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:12.982909 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:50:13.034533 tst ping.py: using LAC 22402 16:50:13.158998 tst ping.py: using RAC 217 16:50:13.281180 tst ping.py: using CellId 22402 16:50:13.406062 tst ping.py: using BVCI 22403 16:50:13.522093 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:13.534229 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:13.545980 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:13.558003 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:13.569934 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:13.582004 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:13.593801 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:13.605875 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:50:13.723530 tst ping.py:19: start network... 16:50:13.936452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:14.425662 run create_hlr_db(pid=24345): Launched 16:50:14.545836 bus /gobi_6: Setting Powered False 16:50:15.609071 run create_hlr_db(pid=24345): Terminated: ok {rc=0} 16:50:16.089948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24347): Launched 16:50:16.435846 run osmo-hlr_10.42.42.2(pid=24348): Launched 16:50:16.653950 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:17.285881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24350): Launched 16:50:17.589697 run osmo-stp_10.42.42.5(pid=24351): Launched 16:50:17.702487 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:18.209338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24353): Launched 16:50:18.321949 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:18.570402 run patchelf(pid=24354): Launched 16:50:18.733560 run osmo-stp_10.42.42.5(pid=24351): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24351)] 16:50:18.857911 run osmo-stp_10.42.42.5(pid=24351): stdout: | (launched: 2022-12-09_16:50:17.535662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:18.983841 run osmo-stp_10.42.42.5(pid=24351): stderr: | [0;m[38;5;43m20221209165017704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165017704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165017704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165017705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165017705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165017705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165017705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:19.110414 run osmo-stp_10.42.42.5(pid=24351): stdout: | (launched: 2022-12-09_16:50:17.535662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:19.230935 run osmo-stp_10.42.42.5(pid=24351): stderr: | [0;m[38;5;43m20221209165017704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165017704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165017704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165017705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165017705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165017705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165017705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:19.373920 run patchelf(pid=24354): Terminating (SIGINT) 16:50:19.537648 run patchelf(pid=24354): Terminated: ok {rc=0} 16:50:19.656108 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24351): Process ended prematurely: osmo-stp_10.42.42.5(pid=24351) [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24351)] [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 16:50:19.664895 tst ping.py:22: Test FAILED (6.7 sec) 16:50:19.691452 run osmo-hlr_10.42.42.2(pid=24348): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24348)] 16:50:19.738488 run osmo-hlr_10.42.42.2(pid=24348): stdout: | (launched: 2022-12-09_16:50:16.367280) 16:50:19.787209 run osmo-hlr_10.42.42.2(pid=24348): stderr: | [0;m[1;31m20221209165016612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165016612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165016612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165016612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165016612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165016612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165016635 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165016652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165016655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165016655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:19.836488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24347): Terminating (SIGTERM) 16:50:19.875805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24350): Terminating (SIGTERM) 16:50:19.915095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24353): Terminating (SIGTERM) 16:50:19.954473 --- ParallelTerminationStrategy: PID 24347 died... 16:50:19.973225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24347): Terminated: ok {rc=0} 16:50:20.016743 --- ParallelTerminationStrategy: PID 24350 died... 16:50:20.035134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24350): Terminated: ok {rc=0} 16:50:20.078765 --- ParallelTerminationStrategy: PID 24353 died... 16:50:20.097265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24353): Terminated: ok {rc=0} 16:50:20.182475 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 16:50:21.271607 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:21.284163 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:50:21.337051 tst ping_idle_ping.py: using LAC 22403 16:50:21.453398 tst ping_idle_ping.py: using RAC 218 16:50:21.568114 tst ping_idle_ping.py: using CellId 22403 16:50:21.684303 tst ping_idle_ping.py: using BVCI 22404 16:50:21.790100 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:21.801746 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:21.812910 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:21.824193 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:21.835398 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:21.846532 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:21.857834 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:21.869062 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:50:21.988608 tst ping_idle_ping.py:24: start network... 16:50:22.203731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:22.697278 run create_hlr_db(pid=24355): Launched 16:50:22.818062 bus /gobi_6: Setting Powered False 16:50:23.880476 run create_hlr_db(pid=24355): Terminated: ok {rc=0} 16:50:24.325833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24357): Launched 16:50:24.644550 run osmo-hlr_10.42.42.2(pid=24358): Launched 16:50:24.765989 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:25.314936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24360): Launched 16:50:25.632283 run osmo-stp_10.42.42.5(pid=24361): Launched 16:50:25.753813 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:26.300130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24363): Launched 16:50:26.422526 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:26.690348 run patchelf(pid=24364): Launched 16:50:26.866318 run osmo-stp_10.42.42.5(pid=24361): ERR: Terminated: ERROR {rc=1} [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24361)] 16:50:27.000212 run osmo-stp_10.42.42.5(pid=24361): stdout: | (launched: 2022-12-09_16:50:25.573909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:27.136028 run osmo-stp_10.42.42.5(pid=24361): stderr: | [0;m[38;5;43m20221209165025765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165025765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165025765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165025766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165025768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165025769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165025769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:27.271592 run osmo-stp_10.42.42.5(pid=24361): stdout: | (launched: 2022-12-09_16:50:25.573909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:27.401501 run osmo-stp_10.42.42.5(pid=24361): stderr: | [0;m[38;5;43m20221209165025765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165025765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165025765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165025766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165025768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165025769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165025769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:27.555037 run patchelf(pid=24364): Terminating (SIGINT) 16:50:27.731459 run patchelf(pid=24364): Terminated: ok {rc=0} 16:50:27.858960 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24361): Process ended prematurely: osmo-stp_10.42.42.5(pid=24361) [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24361)] [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 16:50:27.868511 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:50:27.897688 run osmo-hlr_10.42.42.2(pid=24358): ERR: Terminated: ERROR {rc=237} [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24358)] 16:50:27.947710 run osmo-hlr_10.42.42.2(pid=24358): stdout: | (launched: 2022-12-09_16:50:24.586131) 16:50:27.999731 run osmo-hlr_10.42.42.2(pid=24358): stderr: | [0;m[1;31m20221209165024785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165024785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165024785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165024785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165024785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165024785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165024800 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165024810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165024810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165024810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:28.052325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24357): Terminating (SIGTERM) 16:50:28.094450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24360): Terminating (SIGTERM) 16:50:28.136593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24363): Terminating (SIGTERM) 16:50:28.178851 --- ParallelTerminationStrategy: PID 24357 died... 16:50:28.198839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24357): Terminated: ok {rc=0} 16:50:28.245892 --- ParallelTerminationStrategy: PID 24360 died... 16:50:28.265644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24360): Terminated: ok {rc=0} 16:50:28.312216 --- ParallelTerminationStrategy: PID 24363 died... 16:50:28.331819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24363): Terminated: ok {rc=0} 16:50:28.420463 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 16:50:29.736769 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:50:29.746496 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:50:29.778638 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:50:29.812560 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:50:29.863750 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:50:29.895224 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:50:29.929083 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:50:30.493249 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2361 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:50:30.498204 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:30.509767 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:50:30.574440 tst switch_tch_pdch.py: using LAC 22404 16:50:30.687841 tst switch_tch_pdch.py: using RAC 219 16:50:30.801466 tst switch_tch_pdch.py: using CellId 22404 16:50:30.930754 tst switch_tch_pdch.py: using BVCI 22405 16:50:31.053375 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:31.070597 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:31.084758 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:31.099097 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:31.114045 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:31.127958 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:31.142434 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:50:31.156533 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:50:31.282379 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:50:31.402347 tst switch_tch_pdch.py:51: start network... 16:50:31.651483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:32.121931 run create_hlr_db(pid=24368): Launched 16:50:32.271194 bus /gobi_6: Setting Powered False 16:50:33.329630 run create_hlr_db(pid=24368): Terminated: ok {rc=0} 16:50:33.762651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24370): Launched 16:50:34.078480 run osmo-hlr_10.42.42.2(pid=24371): Launched 16:50:34.198926 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:34.741468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24373): Launched 16:50:35.056714 run osmo-stp_10.42.42.5(pid=24374): Launched 16:50:35.177871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:35.724664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24376): Launched 16:50:35.846176 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:36.113482 run patchelf(pid=24377): Launched 16:50:36.288558 run osmo-stp_10.42.42.5(pid=24374): ERR: Terminated: ERROR {rc=1} [trial-2361↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24374)] 16:50:36.423324 run osmo-stp_10.42.42.5(pid=24374): stdout: | (launched: 2022-12-09_16:50:34.999443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:36.559323 run osmo-stp_10.42.42.5(pid=24374): stderr: | [0;m[38;5;43m20221209165035193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165035193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165035193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165035194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165035194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165035194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165035194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:36.695387 run osmo-stp_10.42.42.5(pid=24374): stdout: | (launched: 2022-12-09_16:50:34.999443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:36.825100 run osmo-stp_10.42.42.5(pid=24374): stderr: | [0;m[38;5;43m20221209165035193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165035193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165035193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165035194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165035194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165035194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165035194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:36.978870 run patchelf(pid=24377): Terminating (SIGINT) 16:50:37.155230 run patchelf(pid=24377): Terminated: ok {rc=0} 16:50:37.282772 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24374): Process ended prematurely: osmo-stp_10.42.42.5(pid=24374) [trial-2361↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24374)] [trial-2361↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:50:37.292355 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 16:50:37.321093 run osmo-hlr_10.42.42.2(pid=24371): ERR: Terminated: ERROR {rc=237} [trial-2361↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24371)] 16:50:37.371823 run osmo-hlr_10.42.42.2(pid=24371): stdout: | (launched: 2022-12-09_16:50:34.021069) 16:50:37.424081 run osmo-hlr_10.42.42.2(pid=24371): stderr: | [0;m[1;31m20221209165034217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165034217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165034217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165034217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165034218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165034218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165034231 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165034239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165034239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165034239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:37.476846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24370): Terminating (SIGTERM) 16:50:37.519322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24373): Terminating (SIGTERM) 16:50:37.561506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24376): Terminating (SIGTERM) 16:50:37.603882 --- ParallelTerminationStrategy: PID 24370 died... 16:50:37.623801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24370): Terminated: ok {rc=0} 16:50:37.670509 --- ParallelTerminationStrategy: PID 24373 died... 16:50:37.690065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24373): Terminated: ok {rc=0} 16:50:37.736568 --- ParallelTerminationStrategy: PID 24376 died... 16:50:37.756064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24376): Terminated: ok {rc=0} 16:50:37.844186 bus /gobi_0: Setting Powered False 16:50:38.943062 bus /gobi_0: Setting Powered False 16:50:40.058783 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2361 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 nitb_smpp --------------------------------------------------------------------- 16:50:41.315185 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:50:41.318119 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 16:50:41.339912 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 16:50:41.347733 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 16:50:41.384780 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 16:50:41.406117 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 16:50:41.413646 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 16:50:41.931449 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2361 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 16:50:41.937036 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 16:50:41.955750 tst esme_connect_policy_acceptall.py: using MSISDN 7275 16:50:42.095549 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:50:42.695271 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24381): Launched 16:50:43.017056 run osmo-nitb_10.42.42.2(pid=24382): Launched 16:50:43.194899 run osmo-nitb_10.42.42.2(pid=24382): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24382)] 16:50:43.338611 run osmo-nitb_10.42.42.2(pid=24382): stdout: | (launched: 2022-12-09_16:50:42.958723) 16:50:43.484526 run osmo-nitb_10.42.42.2(pid=24382): stderr: | (launched: 2022-12-09_16:50:43.006542) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:43.629963 run osmo-nitb_10.42.42.2(pid=24382): stdout: | (launched: 2022-12-09_16:50:42.958723) 16:50:43.769432 run osmo-nitb_10.42.42.2(pid=24382): stderr: | (launched: 2022-12-09_16:50:43.006542) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24382): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24382) [trial-2361↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24382)] 16:50:44.138945 tst osmo-nitb_10.42.42.2(pid=24382): stdout: | (launched: 2022-12-09_16:50:42.958723) 16:50:44.268799 tst osmo-nitb_10.42.42.2(pid=24382): stderr: | (launched: 2022-12-09_16:50:43.006542) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:44.423687 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=24382): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24382) [trial-2361↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24382)] [trial-2361↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 16:50:44.432497 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 16:50:44.439395 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24381): Terminating (SIGTERM) 16:50:44.650388 --- ParallelTerminationStrategy: PID 24381 died... 16:50:44.672632 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24381): Terminated: ok {rc=0} ---------------------------------------------- trial-2361 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 16:50:44.723372 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 16:50:44.744311 tst esme_connect_policy_closed.py: using MSISDN 7276 16:50:44.872646 tst esme_connect_policy_closed.py: using MSISDN 7277 16:50:44.988579 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:50:45.586164 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24383): Launched 16:50:45.941752 run osmo-nitb_10.42.42.2(pid=24384): Launched 16:50:46.136642 run osmo-nitb_10.42.42.2(pid=24384): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24384)] 16:50:46.272741 run osmo-nitb_10.42.42.2(pid=24384): stdout: | (launched: 2022-12-09_16:50:45.867506) 16:50:46.410896 run osmo-nitb_10.42.42.2(pid=24384): stderr: | (launched: 2022-12-09_16:50:45.923946) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:46.548492 run osmo-nitb_10.42.42.2(pid=24384): stdout: | (launched: 2022-12-09_16:50:45.867506) 16:50:46.681239 run osmo-nitb_10.42.42.2(pid=24384): stderr: | (launched: 2022-12-09_16:50:45.923946) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:46.839509 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=24384): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24384) [trial-2361↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24384)] [trial-2361↪nitb_smpp↪esme_connect_policy_closed.py:24] 16:50:46.849375 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 16:50:46.857327 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24383): Terminating (SIGTERM) 16:50:47.071656 --- ParallelTerminationStrategy: PID 24383 died... 16:50:47.097797 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24383): Terminated: ok {rc=0} ---------------------------------------------- trial-2361 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 16:50:47.155604 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 16:50:47.167726 tst nitb_smpp: Using 1 x bts (candidates: 1) 16:50:47.205961 tst esme_ms_sms_storeforward.py: using LAC 22405 16:50:47.332329 tst esme_ms_sms_storeforward.py: using RAC 220 16:50:47.459012 tst esme_ms_sms_storeforward.py: using CellId 22405 16:50:47.585209 tst esme_ms_sms_storeforward.py: using BVCI 22406 16:50:47.702307 tst nitb_smpp: Using 1 x modem (candidates: 1) 16:50:47.829501 tst esme_ms_sms_storeforward.py: using MSISDN 7278 16:50:47.946144 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 16:50:48.166128 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:50:48.823889 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24385): Launched 16:50:49.148441 run osmo-nitb_10.42.42.2(pid=24386): Launched 16:50:49.323667 run osmo-nitb_10.42.42.2(pid=24386): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24386)] 16:50:49.457672 run osmo-nitb_10.42.42.2(pid=24386): stdout: | (launched: 2022-12-09_16:50:49.089357) 16:50:49.592021 run osmo-nitb_10.42.42.2(pid=24386): stderr: | (launched: 2022-12-09_16:50:49.137592) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:49.726767 run osmo-nitb_10.42.42.2(pid=24386): stdout: | (launched: 2022-12-09_16:50:49.089357) 16:50:49.855882 run osmo-nitb_10.42.42.2(pid=24386): stderr: | (launched: 2022-12-09_16:50:49.137592) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:50.010840 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=24386): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24386) [trial-2361↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24386)] [trial-2361↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 16:50:50.019529 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 16:50:50.026411 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24385): Terminating (SIGTERM) 16:50:50.237104 --- ParallelTerminationStrategy: PID 24385 died... 16:50:50.257883 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24385): Terminated: ok {rc=0} 16:50:50.345635 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 16:50:51.432038 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 16:50:51.443690 tst nitb_smpp: Using 1 x bts (candidates: 1) 16:50:51.481895 tst esme_ms_sms_transaction.py: using LAC 22406 16:50:51.602639 tst esme_ms_sms_transaction.py: using RAC 221 16:50:51.727759 tst esme_ms_sms_transaction.py: using CellId 22406 16:50:51.861118 tst esme_ms_sms_transaction.py: using BVCI 22407 16:50:51.971786 tst nitb_smpp: Using 1 x modem (candidates: 1) 16:50:52.120196 tst esme_ms_sms_transaction.py: using MSISDN 7279 16:50:52.258523 tst esme_ms_sms_transaction.py:18: start nitb and bts... 16:50:52.478859 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:50:53.133765 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24392): Launched 16:50:53.455786 run osmo-nitb_10.42.42.2(pid=24393): Launched 16:50:53.634162 run osmo-nitb_10.42.42.2(pid=24393): ERR: Terminated: ERROR {rc=2} [trial-2361↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24393)] 16:50:53.778838 run osmo-nitb_10.42.42.2(pid=24393): stdout: | (launched: 2022-12-09_16:50:53.397339) 16:50:53.924831 run osmo-nitb_10.42.42.2(pid=24393): stderr: | (launched: 2022-12-09_16:50:53.445292) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:54.070631 run osmo-nitb_10.42.42.2(pid=24393): stdout: | (launched: 2022-12-09_16:50:53.397339) 16:50:54.210629 run osmo-nitb_10.42.42.2(pid=24393): stderr: | (launched: 2022-12-09_16:50:53.445292) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7e579f2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24393): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24393) [trial-2361↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24393)] 16:50:54.577487 tst osmo-nitb_10.42.42.2(pid=24393): stdout: | (launched: 2022-12-09_16:50:53.397339) 16:50:54.707602 tst osmo-nitb_10.42.42.2(pid=24393): stderr: | (launched: 2022-12-09_16:50:53.445292) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:50:54.861049 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=24393): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24393) [trial-2361↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24393)] [trial-2361↪nitb_smpp↪esme_ms_sms_transaction.py:21] 16:50:54.870076 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 16:50:54.876855 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24392): Terminating (SIGTERM) 16:50:55.087530 --- ParallelTerminationStrategy: PID 24392 died... 16:50:55.108818 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24392): Terminated: ok {rc=0} 16:50:55.195783 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 smpp --------------------------------------------------------------------- 16:50:56.364038 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:50:56.366913 tst smpp: Verifying 1 x bts (candidates: 11) 16:50:56.388021 tst smpp: Verifying 6 x ip_address (candidates: 9) 16:50:56.415834 tst smpp: Verifying 1 x modem (candidates: 12) 16:50:56.453234 tst smpp: Reserving 1 x bts (candidates: 11) 16:50:56.474967 tst smpp: Reserving 6 x ip_address (candidates: 9) 16:50:56.502636 tst smpp: Reserving 1 x modem (candidates: 12) 16:50:57.027750 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2361 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 16:50:57.032847 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:57.043933 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:57.055204 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:57.066530 tst smpp: Using 1 x ip_address (candidates: 6) 16:50:57.085777 tst esme_connect_policy_acceptall.py: using MSISDN 7280 16:50:57.198668 run osmo-stp_10.42.42.4: Starting osmo-stp 16:50:57.712449 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=24397): Launched 16:50:58.014482 run osmo-stp_10.42.42.4(pid=24398): Launched 16:50:58.130307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:58.597649 run create_hlr_db(pid=24399): Launched 16:50:58.721658 bus /sierra_2: Setting Powered False 16:50:59.782087 run create_hlr_db(pid=24399): Terminated: ok {rc=0} 16:51:00.206405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24401): Launched 16:51:00.511028 run osmo-hlr_10.42.42.2(pid=24402): Launched 16:51:00.627142 run osmo-msc_10.42.42.5: Starting osmo-msc 16:51:01.261744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24404): Launched 16:51:01.589673 run osmo-msc_10.42.42.5(pid=24405): Launched 16:51:01.957464 run osmo-hlr_10.42.42.2(pid=24402): ERR: Terminated: ERROR {rc=237} [trial-2361↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24402)] 16:51:02.149414 run osmo-hlr_10.42.42.2(pid=24402): stdout: | (launched: 2022-12-09_16:51:00.454473) 16:51:02.346069 run osmo-hlr_10.42.42.2(pid=24402): stderr: | [0;m[1;31m20221209165100628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165100628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165100628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165100628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165100628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165100628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165100640 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165100649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165100649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165100649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:02.485296 run osmo-hlr_10.42.42.2(pid=24402): stdout: | (launched: 2022-12-09_16:51:00.454473) 16:51:02.616639 run osmo-hlr_10.42.42.2(pid=24402): stderr: | [0;m[1;31m20221209165100628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165100628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165100628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165100628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165100628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165100628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165100640 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165100649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165100649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165100649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:02.772865 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=24402): Process ended prematurely: osmo-hlr_10.42.42.2(pid=24402) [trial-2361↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24402)] [trial-2361↪smpp↪esme_connect_policy_acceptall.py:23] 16:51:02.781826 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.7 sec) 16:51:02.809360 run osmo-msc_10.42.42.5(pid=24405): ERR: Terminated: ERROR {rc=9} [trial-2361↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=24405)] 16:51:02.859821 run osmo-msc_10.42.42.5(pid=24405): stdout: | (launched: 2022-12-09_16:51:01.520325) 16:51:02.911802 run osmo-msc_10.42.42.5(pid=24405): stderr: | [0;m[38;5;43m20221209165102125 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221209165102125 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221209165102125 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221209165102125 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221209165102125 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221209165102125 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221209165102125 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221209165102126 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209165102126 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 16:51:02.964169 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=24397): Terminating (SIGTERM) 16:51:03.006252 run osmo-stp_10.42.42.4(pid=24398): Terminating (SIGTERM) 16:51:03.048096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24401): Terminating (SIGTERM) 16:51:03.092059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24404): Terminating (SIGTERM) 16:51:03.137317 --- ParallelTerminationStrategy: PID 24397 died... 16:51:03.157954 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=24397): Terminated: ok {rc=0} 16:51:03.206659 --- ParallelTerminationStrategy: PID 24398 died... 16:51:03.226534 run osmo-stp_10.42.42.4(pid=24398): Terminated: ok {rc=0} 16:51:03.273047 --- ParallelTerminationStrategy: PID 24401 died... 16:51:03.292287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24401): Terminated: ok {rc=0} 16:51:03.338831 --- ParallelTerminationStrategy: PID 24404 died... 16:51:03.358428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24404): Terminated: ok {rc=0} ---------------------------------------------- trial-2361 smpp esme_connect_policy_closed.py ---------------------------------------------- 16:51:03.410718 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:03.422429 tst smpp: Using 1 x bts (candidates: 1) 16:51:03.460150 tst esme_connect_policy_closed.py: using LAC 22407 16:51:03.589654 tst esme_connect_policy_closed.py: using RAC 222 16:51:03.717099 tst esme_connect_policy_closed.py: using CellId 22407 16:51:03.845380 tst esme_connect_policy_closed.py: using BVCI 22408 16:51:03.963410 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:03.974346 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:03.985191 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:04.006386 tst esme_connect_policy_closed.py: using MSISDN 7281 16:51:04.128204 tst esme_connect_policy_closed.py: using MSISDN 7282 16:51:04.238860 run osmo-stp_10.42.42.4: Starting osmo-stp 16:51:04.758933 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=24408): Launched 16:51:05.066200 run osmo-stp_10.42.42.4(pid=24409): Launched 16:51:05.184813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:05.655539 run create_hlr_db(pid=24410): Launched 16:51:06.835650 run create_hlr_db(pid=24410): Terminated: ok {rc=0} 16:51:07.157963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24412): Launched 16:51:07.463709 run osmo-hlr_10.42.42.2(pid=24413): Launched 16:51:07.580356 run osmo-msc_10.42.42.5: Starting osmo-msc 16:51:08.138056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24415): Launched 16:51:08.446971 run osmo-msc_10.42.42.5(pid=24416): Launched 16:51:08.619426 run osmo-hlr_10.42.42.2(pid=24413): ERR: Terminated: ERROR {rc=237} [trial-2361↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24413)] 16:51:08.750954 run osmo-hlr_10.42.42.2(pid=24413): stdout: | (launched: 2022-12-09_16:51:07.407665) 16:51:08.880423 run osmo-hlr_10.42.42.2(pid=24413): stderr: | [0;m[1;31m20221209165107582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165107582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165107582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165107583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165107583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165107583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165107595 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165107604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165107604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165107604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:09.007632 run osmo-hlr_10.42.42.2(pid=24413): stdout: | (launched: 2022-12-09_16:51:07.407665) 16:51:09.129604 run osmo-hlr_10.42.42.2(pid=24413): stderr: | [0;m[1;31m20221209165107582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165107582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165107582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165107583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165107583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165107583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165107595 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165107604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165107604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165107604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:09.275875 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=24413): Process ended prematurely: osmo-hlr_10.42.42.2(pid=24413) [trial-2361↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24413)] [trial-2361↪smpp↪esme_connect_policy_closed.py:31] 16:51:09.284085 tst esme_connect_policy_closed.py:31: Test FAILED (5.9 sec) 16:51:09.309725 run osmo-msc_10.42.42.5(pid=24416): ERR: Terminated: ERROR {rc=9} [trial-2361↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=24416)] 16:51:09.357401 run osmo-msc_10.42.42.5(pid=24416): stdout: | (launched: 2022-12-09_16:51:08.390528) 16:51:09.406261 run osmo-msc_10.42.42.5(pid=24416): stderr: | [0;m[38;5;43m20221209165108708 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221209165108708 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221209165108708 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221209165108708 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221209165108708 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221209165108709 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221209165108709 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221209165108709 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209165108709 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 16:51:09.455511 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=24408): Terminating (SIGTERM) 16:51:09.495169 run osmo-stp_10.42.42.4(pid=24409): Terminating (SIGTERM) 16:51:09.534694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24412): Terminating (SIGTERM) 16:51:09.575742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24415): Terminating (SIGTERM) 16:51:09.616446 --- ParallelTerminationStrategy: PID 24408 died... 16:51:09.635390 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=24408): Terminated: ok {rc=0} 16:51:09.679098 --- ParallelTerminationStrategy: PID 24409 died... 16:51:09.697450 run osmo-stp_10.42.42.4(pid=24409): Terminated: ok {rc=0} 16:51:09.741043 --- ParallelTerminationStrategy: PID 24412 died... 16:51:09.759497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24412): Terminated: ok {rc=0} 16:51:09.803535 --- ParallelTerminationStrategy: PID 24415 died... 16:51:09.822003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24415): Terminated: ok {rc=0} ---------------------------------------------- trial-2361 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 16:51:09.869968 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:09.881132 tst smpp: Using 1 x bts (candidates: 1) 16:51:09.921218 tst esme_ms_sms_storeforward.py: using LAC 22408 16:51:10.043495 tst esme_ms_sms_storeforward.py: using RAC 223 16:51:10.164022 tst esme_ms_sms_storeforward.py: using CellId 22408 16:51:10.282528 tst esme_ms_sms_storeforward.py: using BVCI 22409 16:51:10.395179 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:10.405758 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:10.416007 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:10.426794 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:10.437611 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:10.448322 tst smpp: Using 1 x modem (candidates: 1) 16:51:10.577866 tst esme_ms_sms_storeforward.py: using MSISDN 7283 16:51:10.696569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:11.203126 run create_hlr_db(pid=24419): Launched 16:51:12.387346 run create_hlr_db(pid=24419): Terminated: ok {rc=0} 16:51:12.733568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24421): Launched 16:51:13.061774 run osmo-hlr_10.42.42.2(pid=24422): Launched 16:51:13.188839 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:13.759314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24424): Launched 16:51:14.088648 run osmo-stp_10.42.42.5(pid=24425): Launched 16:51:14.214607 run osmo-msc_10.42.42.6: Starting osmo-msc 16:51:14.808618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24427): Launched 16:51:15.138321 run osmo-msc_10.42.42.6(pid=24428): Launched 16:51:15.321573 run osmo-stp_10.42.42.5(pid=24425): ERR: Terminated: ERROR {rc=1} [trial-2361↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24425)] 16:51:15.460508 run osmo-stp_10.42.42.5(pid=24425): stdout: | (launched: 2022-12-09_16:51:14.028650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:15.600047 run osmo-stp_10.42.42.5(pid=24425): stderr: | [0;m[38;5;43m20221209165114226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165114226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165114226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165114227 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165114227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165114227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165114227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:15.737843 run osmo-stp_10.42.42.5(pid=24425): stdout: | (launched: 2022-12-09_16:51:14.028650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:15.879828 run osmo-stp_10.42.42.5(pid=24425): stderr: | [0;m[38;5;43m20221209165114226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165114226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165114226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165114227 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165114227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165114227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165114227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:16.053549 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=24425): Process ended prematurely: osmo-stp_10.42.42.5(pid=24425) [trial-2361↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24425)] [trial-2361↪smpp↪esme_ms_sms_storeforward.py:30] 16:51:16.065630 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.2 sec) 16:51:16.105010 run osmo-hlr_10.42.42.2(pid=24422): ERR: Terminated: ERROR {rc=237} [trial-2361↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24422)] 16:51:16.170331 run osmo-hlr_10.42.42.2(pid=24422): stdout: | (launched: 2022-12-09_16:51:13.002008) 16:51:16.238143 run osmo-hlr_10.42.42.2(pid=24422): stderr: | [0;m[1;31m20221209165113205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165113205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165113205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165113205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165113205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165113205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165113216 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165113225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165113225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165113225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:16.331531 run osmo-msc_10.42.42.6(pid=24428): ERR: Terminated: ERROR {rc=2} [trial-2361↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24428)] 16:51:16.397121 run osmo-msc_10.42.42.6(pid=24428): stdout: | (launched: 2022-12-09_16:51:15.077718) 16:51:16.461921 run osmo-msc_10.42.42.6(pid=24428): stderr: | [0;m[38;5;43m20221209165115402 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165115402 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f54b4226c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165115402 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165115402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165115402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165115402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165115404 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165115405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165115405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165115405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:51:16.530631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24421): Terminating (SIGTERM) 16:51:16.585380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24424): Terminating (SIGTERM) 16:51:16.632785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24427): Terminating (SIGTERM) 16:51:16.679363 --- ParallelTerminationStrategy: PID 24421 died... 16:51:16.699823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24421): Terminated: ok {rc=0} 16:51:16.750608 --- ParallelTerminationStrategy: PID 24424 died... 16:51:16.770612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24424): Terminated: ok {rc=0} 16:51:16.820411 --- ParallelTerminationStrategy: PID 24427 died... 16:51:16.840426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24427): Terminated: ok {rc=0} 16:51:16.928754 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 smpp esme_ms_sms_transaction.py ---------------------------------------------- 16:51:18.015585 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:18.027017 tst smpp: Using 1 x bts (candidates: 1) 16:51:18.064922 tst esme_ms_sms_transaction.py: using LAC 22409 16:51:18.194625 tst esme_ms_sms_transaction.py: using RAC 224 16:51:18.326601 tst esme_ms_sms_transaction.py: using CellId 22409 16:51:18.456005 tst esme_ms_sms_transaction.py: using BVCI 22410 16:51:18.574608 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:18.585669 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:18.596639 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:18.608025 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:18.619141 tst smpp: Using 1 x ip_address (candidates: 6) 16:51:18.630232 tst smpp: Using 1 x modem (candidates: 1) 16:51:18.755960 tst esme_ms_sms_transaction.py: using MSISDN 7284 16:51:18.867597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:19.340529 run create_hlr_db(pid=24430): Launched 16:51:19.466359 bus /sierra_2: Setting Powered False 16:51:20.526681 run create_hlr_db(pid=24430): Terminated: ok {rc=0} 16:51:20.975852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24432): Launched 16:51:21.305360 run osmo-hlr_10.42.42.2(pid=24433): Launched 16:51:21.430863 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:21.998879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24435): Launched 16:51:22.326753 run osmo-stp_10.42.42.5(pid=24436): Launched 16:51:22.454112 run osmo-msc_10.42.42.6: Starting osmo-msc 16:51:23.047117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24438): Launched 16:51:23.377612 run osmo-msc_10.42.42.6(pid=24439): Launched 16:51:23.564046 run osmo-stp_10.42.42.5(pid=24436): ERR: Terminated: ERROR {rc=1} [trial-2361↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24436)] 16:51:23.703153 run osmo-stp_10.42.42.5(pid=24436): stdout: | (launched: 2022-12-09_16:51:22.267131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:23.843055 run osmo-stp_10.42.42.5(pid=24436): stderr: | [0;m[38;5;43m20221209165122461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165122461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165122461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165122462 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165122462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165122462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165122462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:23.979735 run osmo-stp_10.42.42.5(pid=24436): stdout: | (launched: 2022-12-09_16:51:22.267131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:24.110807 run osmo-stp_10.42.42.5(pid=24436): stderr: | [0;m[38;5;43m20221209165122461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165122461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165122461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165122462 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165122462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165122462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165122462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:24.267527 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=24436): Process ended prematurely: osmo-stp_10.42.42.5(pid=24436) [trial-2361↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24436)] [trial-2361↪smpp↪esme_ms_sms_transaction.py:28] 16:51:24.276652 tst esme_ms_sms_transaction.py:28: Test FAILED (6.3 sec) 16:51:24.304672 run osmo-hlr_10.42.42.2(pid=24433): ERR: Terminated: ERROR {rc=237} [trial-2361↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24433)] 16:51:24.354907 run osmo-hlr_10.42.42.2(pid=24433): stdout: | (launched: 2022-12-09_16:51:21.245359) 16:51:24.407388 run osmo-hlr_10.42.42.2(pid=24433): stderr: | [0;m[1;31m20221209165121446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165121447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165121447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165121447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165121447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165121447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165121459 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165121467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165121467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165121467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:24.479745 run osmo-msc_10.42.42.6(pid=24439): ERR: Terminated: ERROR {rc=2} [trial-2361↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24439)] 16:51:24.529956 run osmo-msc_10.42.42.6(pid=24439): stdout: | (launched: 2022-12-09_16:51:23.317615) 16:51:24.581993 run osmo-msc_10.42.42.6(pid=24439): stderr: | [0;m[38;5;43m20221209165123639 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165123639 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2f776d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165123639 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165123639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165123639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165123640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165123642 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165123642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165123642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165123642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:51:24.634538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24432): Terminating (SIGTERM) 16:51:24.676922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24435): Terminating (SIGTERM) 16:51:24.719193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24438): Terminating (SIGTERM) 16:51:24.761548 --- ParallelTerminationStrategy: PID 24432 died... 16:51:24.781593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24432): Terminated: ok {rc=0} 16:51:24.828561 --- ParallelTerminationStrategy: PID 24435 died... 16:51:24.848189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24435): Terminated: ok {rc=0} 16:51:24.894721 --- ParallelTerminationStrategy: PID 24438 died... 16:51:24.914448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24438): Terminated: ok {rc=0} 16:51:25.003794 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 encryption --------------------------------------------------------------------- 16:51:26.200852 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:51:26.204350 tst encryption: Verifying 1 x bts (candidates: 11) 16:51:26.226756 tst encryption: Verifying 6 x ip_address (candidates: 9) 16:51:26.254881 tst encryption: Verifying 1 x modem (candidates: 12) 16:51:26.292075 tst encryption: Reserving 1 x bts (candidates: 11) 16:51:26.313472 tst encryption: Reserving 6 x ip_address (candidates: 9) 16:51:26.340744 tst encryption: Reserving 1 x modem (candidates: 12) 16:51:26.870637 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2361 encryption register_a5_0_authopt.py ---------------------------------------------- 16:51:26.926788 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:26.938108 tst encryption: Using 1 x bts (candidates: 1) 16:51:26.973976 tst register_a5_0_authopt.py: using LAC 22410 16:51:27.106284 tst register_a5_0_authopt.py: using RAC 225 16:51:27.234710 tst register_a5_0_authopt.py: using CellId 22410 16:51:27.364075 tst register_a5_0_authopt.py: using BVCI 22411 16:51:27.485293 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:27.496221 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:27.507180 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:27.518815 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:27.530558 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:27.541980 tst encryption: Using 1 x modem (candidates: 1) 16:51:27.660481 tst register_a5_0_authopt.py:8: start network... 16:51:27.869878 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:28.347278 run create_hlr_db(pid=24444): Launched 16:51:28.474284 bus /sierra_2: Setting Powered False 16:51:29.535411 run create_hlr_db(pid=24444): Terminated: ok {rc=0} 16:51:29.988850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24446): Launched 16:51:30.320419 run osmo-hlr_10.42.42.2(pid=24447): Launched 16:51:30.448562 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:31.041779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24449): Launched 16:51:31.388253 run osmo-stp_10.42.42.5(pid=24450): Launched 16:51:31.642818 run osmo-msc_10.42.42.6: Starting osmo-msc 16:51:32.322187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24452): Launched 16:51:32.655211 run osmo-msc_10.42.42.6(pid=24453): Launched 16:51:32.840743 run osmo-stp_10.42.42.5(pid=24450): ERR: Terminated: ERROR {rc=1} [trial-2361↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24450)] 16:51:32.979613 run osmo-stp_10.42.42.5(pid=24450): stdout: | (launched: 2022-12-09_16:51:31.323214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:33.119789 run osmo-stp_10.42.42.5(pid=24450): stderr: | [0;m[38;5;43m20221209165131634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165131634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165131635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165131635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165131636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165131636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165131636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:33.258443 run osmo-stp_10.42.42.5(pid=24450): stdout: | (launched: 2022-12-09_16:51:31.323214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:33.390303 run osmo-stp_10.42.42.5(pid=24450): stderr: | [0;m[38;5;43m20221209165131634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165131634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165131635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165131635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165131636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165131636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165131636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:33.548412 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24450): Process ended prematurely: osmo-stp_10.42.42.5(pid=24450) [trial-2361↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24450)] [trial-2361↪encryption↪register_a5_0_authopt.py:8] 16:51:33.558017 tst register_a5_0_authopt.py:8: Test FAILED (6.7 sec) 16:51:33.585710 run osmo-hlr_10.42.42.2(pid=24447): ERR: Terminated: ERROR {rc=237} [trial-2361↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24447)] 16:51:33.635817 run osmo-hlr_10.42.42.2(pid=24447): stdout: | (launched: 2022-12-09_16:51:30.260291) 16:51:33.687313 run osmo-hlr_10.42.42.2(pid=24447): stderr: | [0;m[1;31m20221209165130460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165130460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165130460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165130460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165130460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165130460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165130472 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165130480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165130481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165130481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:33.759200 run osmo-msc_10.42.42.6(pid=24453): ERR: Terminated: ERROR {rc=2} [trial-2361↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24453)] 16:51:33.809131 run osmo-msc_10.42.42.6(pid=24453): stdout: | (launched: 2022-12-09_16:51:32.594969) 16:51:33.860657 run osmo-msc_10.42.42.6(pid=24453): stderr: | [0;m[38;5;43m20221209165132918 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165132918 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5083014c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165132918 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165132918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165132918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165132918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165132920 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165132920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165132920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165132920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:51:33.912713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24446): Terminating (SIGTERM) 16:51:33.954270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24449): Terminating (SIGTERM) 16:51:33.996051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24452): Terminating (SIGTERM) 16:51:34.038066 --- ParallelTerminationStrategy: PID 24446 died... 16:51:34.057956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24446): Terminated: ok {rc=0} 16:51:34.104282 --- ParallelTerminationStrategy: PID 24449 died... 16:51:34.123619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24449): Terminated: ok {rc=0} 16:51:34.169545 --- ParallelTerminationStrategy: PID 24452 died... 16:51:34.188797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24452): Terminated: ok {rc=0} 16:51:34.275196 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 encryption register_a5_0_authreq.py ---------------------------------------------- 16:51:35.427605 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:35.439430 tst encryption: Using 1 x bts (candidates: 1) 16:51:35.477552 tst register_a5_0_authreq.py: using LAC 22411 16:51:35.606274 tst register_a5_0_authreq.py: using RAC 226 16:51:35.734060 tst register_a5_0_authreq.py: using CellId 22411 16:51:35.862816 tst register_a5_0_authreq.py: using BVCI 22412 16:51:35.983424 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:35.994518 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:36.005537 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:36.016585 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:36.027754 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:36.038977 tst encryption: Using 1 x modem (candidates: 1) 16:51:36.161489 tst register_a5_0_authreq.py:8: start network... 16:51:36.386785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:36.898956 run create_hlr_db(pid=24455): Launched 16:51:37.026273 bus /sierra_2: Setting Powered False 16:51:38.091375 run create_hlr_db(pid=24455): Terminated: ok {rc=0} 16:51:38.531807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24457): Launched 16:51:38.843534 run osmo-hlr_10.42.42.2(pid=24458): Launched 16:51:38.961822 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:39.508339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24460): Launched 16:51:39.817778 run osmo-stp_10.42.42.5(pid=24461): Launched 16:51:39.936479 run osmo-msc_10.42.42.6: Starting osmo-msc 16:51:40.493713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24463): Launched 16:51:40.803624 run osmo-msc_10.42.42.6(pid=24464): Launched 16:51:40.978284 run osmo-stp_10.42.42.5(pid=24461): ERR: Terminated: ERROR {rc=1} [trial-2361↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24461)] 16:51:41.108645 run osmo-stp_10.42.42.5(pid=24461): stdout: | (launched: 2022-12-09_16:51:39.760522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:41.239181 run osmo-stp_10.42.42.5(pid=24461): stderr: | [0;m[38;5;43m20221209165139932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165139932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165139932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165139933 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165139933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165139933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165139933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:41.367439 run osmo-stp_10.42.42.5(pid=24461): stdout: | (launched: 2022-12-09_16:51:39.760522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:41.490304 run osmo-stp_10.42.42.5(pid=24461): stderr: | [0;m[38;5;43m20221209165139932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165139932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165139932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165139933 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165139933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165139933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165139933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:41.637648 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24461): Process ended prematurely: osmo-stp_10.42.42.5(pid=24461) [trial-2361↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24461)] [trial-2361↪encryption↪register_a5_0_authreq.py:8] 16:51:41.646350 tst register_a5_0_authreq.py:8: Test FAILED (6.3 sec) 16:51:41.672398 run osmo-hlr_10.42.42.2(pid=24458): ERR: Terminated: ERROR {rc=237} [trial-2361↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24458)] 16:51:41.719683 run osmo-hlr_10.42.42.2(pid=24458): stdout: | (launched: 2022-12-09_16:51:38.786072) 16:51:41.768335 run osmo-hlr_10.42.42.2(pid=24458): stderr: | [0;m[1;31m20221209165138962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165138962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165138962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165138962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165138962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165138963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165138975 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165138983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165138983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165138983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:41.836626 run osmo-msc_10.42.42.6(pid=24464): ERR: Terminated: ERROR {rc=2} [trial-2361↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24464)] 16:51:41.883731 run osmo-msc_10.42.42.6(pid=24464): stdout: | (launched: 2022-12-09_16:51:40.746694) 16:51:41.932401 run osmo-msc_10.42.42.6(pid=24464): stderr: | [0;m[38;5;43m20221209165141019 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165141020 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb66f919c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165141020 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165141020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165141020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165141020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165141022 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165141022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165141023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165141023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:51:41.981577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24457): Terminating (SIGTERM) 16:51:42.021613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24460): Terminating (SIGTERM) 16:51:42.061181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24463): Terminating (SIGTERM) 16:51:42.100755 --- ParallelTerminationStrategy: PID 24457 died... 16:51:42.119620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24457): Terminated: ok {rc=0} 16:51:42.163231 --- ParallelTerminationStrategy: PID 24460 died... 16:51:42.181633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24460): Terminated: ok {rc=0} 16:51:42.225158 --- ParallelTerminationStrategy: PID 24463 died... 16:51:42.243558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24463): Terminated: ok {rc=0} 16:51:42.326247 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 encryption register_a5_1_authreq.py ---------------------------------------------- 16:51:43.476108 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:43.488108 tst encryption: Using 1 x bts (candidates: 1) 16:51:43.530807 tst register_a5_1_authreq.py: using LAC 22412 16:51:43.652100 tst register_a5_1_authreq.py: using RAC 227 16:51:43.770811 tst register_a5_1_authreq.py: using CellId 22412 16:51:43.891559 tst register_a5_1_authreq.py: using BVCI 22413 16:51:44.004686 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:44.015293 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:44.025942 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:44.036295 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:44.046678 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:44.056891 tst encryption: Using 1 x modem (candidates: 1) 16:51:44.174736 tst register_a5_1_authreq.py:8: start network... 16:51:44.401763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:44.915133 run create_hlr_db(pid=24466): Launched 16:51:45.044034 bus /sierra_2: Setting Powered False 16:51:46.143247 run create_hlr_db(pid=24466): Terminated: ok {rc=0} 16:51:46.614917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24468): Launched 16:51:46.947893 run osmo-hlr_10.42.42.2(pid=24469): Launched 16:51:47.216495 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:47.814289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24471): Launched 16:51:48.147566 run osmo-stp_10.42.42.5(pid=24472): Launched 16:51:48.277095 run osmo-msc_10.42.42.6: Starting osmo-msc 16:51:48.877787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24474): Launched 16:51:49.211788 run osmo-msc_10.42.42.6(pid=24475): Launched 16:51:49.397707 run osmo-stp_10.42.42.5(pid=24472): ERR: Terminated: ERROR {rc=1} [trial-2361↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24472)] 16:51:49.537690 run osmo-stp_10.42.42.5(pid=24472): stdout: | (launched: 2022-12-09_16:51:48.087201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:49.678522 run osmo-stp_10.42.42.5(pid=24472): stderr: | [0;m[38;5;43m20221209165148282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165148282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165148282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165148283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165148283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165148283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165148283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:49.816528 run osmo-stp_10.42.42.5(pid=24472): stdout: | (launched: 2022-12-09_16:51:48.087201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:49.948831 run osmo-stp_10.42.42.5(pid=24472): stderr: | [0;m[38;5;43m20221209165148282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165148282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165148282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165148283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165148283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165148283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165148283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:50.107648 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24472): Process ended prematurely: osmo-stp_10.42.42.5(pid=24472) [trial-2361↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24472)] [trial-2361↪encryption↪register_a5_1_authreq.py:8] 16:51:50.117146 tst register_a5_1_authreq.py:8: Test FAILED (6.7 sec) 16:51:50.145216 run osmo-hlr_10.42.42.2(pid=24469): ERR: Terminated: ERROR {rc=237} [trial-2361↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24469)] 16:51:50.195382 run osmo-hlr_10.42.42.2(pid=24469): stdout: | (launched: 2022-12-09_16:51:46.888923) 16:51:50.247734 run osmo-hlr_10.42.42.2(pid=24469): stderr: | [0;m[1;31m20221209165147133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165147133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165147133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165147133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165147133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165147133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165147143 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165147159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165147159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165147159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:50.320738 run osmo-msc_10.42.42.6(pid=24475): ERR: Terminated: ERROR {rc=2} [trial-2361↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24475)] 16:51:50.371051 run osmo-msc_10.42.42.6(pid=24475): stdout: | (launched: 2022-12-09_16:51:49.151463) 16:51:50.423069 run osmo-msc_10.42.42.6(pid=24475): stderr: | [0;m[38;5;43m20221209165149473 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165149473 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4a2dbc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165149473 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165149473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165149473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165149473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165149475 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165149475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165149476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165149476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:51:50.475230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24468): Terminating (SIGTERM) 16:51:50.516836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24471): Terminating (SIGTERM) 16:51:50.558817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24474): Terminating (SIGTERM) 16:51:50.600759 --- ParallelTerminationStrategy: PID 24468 died... 16:51:50.620482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24468): Terminated: ok {rc=0} 16:51:50.667435 --- ParallelTerminationStrategy: PID 24471 died... 16:51:50.686859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24471): Terminated: ok {rc=0} 16:51:50.733101 --- ParallelTerminationStrategy: PID 24474 died... 16:51:50.752329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24474): Terminated: ok {rc=0} 16:51:50.840808 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2361 encryption register_a5_3_authreq.py ---------------------------------------------- 16:51:51.993297 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:52.005058 tst encryption: Using 1 x bts (candidates: 1) 16:51:52.042107 tst register_a5_3_authreq.py: using LAC 22413 16:51:52.171659 tst register_a5_3_authreq.py: using RAC 228 16:51:52.301766 tst register_a5_3_authreq.py: using CellId 22413 16:51:52.431879 tst register_a5_3_authreq.py: using BVCI 22414 16:51:52.554046 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:52.564936 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:52.575886 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:52.586995 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:52.598072 tst encryption: Using 1 x ip_address (candidates: 6) 16:51:52.608909 tst encryption: Using 1 x modem (candidates: 1) 16:51:52.737608 tst register_a5_3_authreq.py:8: start network... 16:51:52.947627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:53.424334 run create_hlr_db(pid=24477): Launched 16:51:53.551097 bus /sierra_2: Setting Powered False 16:51:54.612665 run create_hlr_db(pid=24477): Terminated: ok {rc=0} 16:51:55.043461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24479): Launched 16:51:55.353361 run osmo-hlr_10.42.42.2(pid=24480): Launched 16:51:55.471170 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:56.004289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24482): Launched 16:51:56.314382 run osmo-stp_10.42.42.5(pid=24483): Launched 16:51:56.436254 run osmo-msc_10.42.42.6: Starting osmo-msc 16:51:57.008673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24485): Launched 16:51:57.317514 run osmo-msc_10.42.42.6(pid=24486): Launched 16:51:57.495492 run osmo-stp_10.42.42.5(pid=24483): ERR: Terminated: ERROR {rc=1} [trial-2361↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24483)] 16:51:57.625556 run osmo-stp_10.42.42.5(pid=24483): stdout: | (launched: 2022-12-09_16:51:56.258076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:57.755951 run osmo-stp_10.42.42.5(pid=24483): stderr: | [0;m[38;5;43m20221209165156431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165156431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165156432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165156432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165156433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165156433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165156433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:57.884194 run osmo-stp_10.42.42.5(pid=24483): stdout: | (launched: 2022-12-09_16:51:56.258076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:58.007291 run osmo-stp_10.42.42.5(pid=24483): stderr: | [0;m[38;5;43m20221209165156431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165156431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165156432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165156432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165156433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165156433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165156433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:58.154675 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24483): Process ended prematurely: osmo-stp_10.42.42.5(pid=24483) [trial-2361↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24483)] [trial-2361↪encryption↪register_a5_3_authreq.py:8] 16:51:58.163526 tst register_a5_3_authreq.py:8: Test FAILED (6.2 sec) 16:51:58.189452 run osmo-hlr_10.42.42.2(pid=24480): ERR: Terminated: ERROR {rc=237} [trial-2361↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24480)] 16:51:58.236514 run osmo-hlr_10.42.42.2(pid=24480): stdout: | (launched: 2022-12-09_16:51:55.296500) 16:51:58.285235 run osmo-hlr_10.42.42.2(pid=24480): stderr: | [0;m[1;31m20221209165155472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165155472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165155472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165155472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165155473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165155473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165155484 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165155492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165155493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165155493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:58.353374 run osmo-msc_10.42.42.6(pid=24486): ERR: Terminated: ERROR {rc=2} [trial-2361↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24486)] 16:51:58.400349 run osmo-msc_10.42.42.6(pid=24486): stdout: | (launched: 2022-12-09_16:51:57.260864) 16:51:58.449200 run osmo-msc_10.42.42.6(pid=24486): stderr: | [0;m[38;5;43m20221209165157533 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165157533 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6fa291dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165157533 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165157533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165157533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165157533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165157535 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165157535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165157536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165157536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:51:58.498120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24479): Terminating (SIGTERM) 16:51:58.537282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24482): Terminating (SIGTERM) 16:51:58.576533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24485): Terminating (SIGTERM) 16:51:58.615980 --- ParallelTerminationStrategy: PID 24479 died... 16:51:58.634789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24479): Terminated: ok {rc=0} 16:51:58.677967 --- ParallelTerminationStrategy: PID 24482 died... 16:51:58.696265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24482): Terminated: ok {rc=0} 16:51:58.739593 --- ParallelTerminationStrategy: PID 24485 died... 16:51:58.757867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24485): Terminated: ok {rc=0} 16:51:58.840897 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 16:52:00.049872 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:52:00.055439 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 16:52:00.073656 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 16:52:00.100336 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 16:52:00.127160 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 16:52:00.145311 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 16:52:00.171579 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 16:52:00.684673 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2361 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 16:52:00.689542 tst handover.py:11: TEST_CONFIG: {} 16:52:00.926026 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:52:00.942321 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:52:00.965813 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:52:01.018083 tst handover.py: using MSISDN 7285 16:52:01.132358 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7285', subscriber_id=0} 16:52:01.241636 run srsepc_10.42.42.118: Starting srsepc 16:52:03.114096 run rm-remote-dir(pid=24491): Launched 16:52:03.240308 bus /sierra_2: Setting Powered False 16:52:04.306044 run rm-remote-dir(pid=24491): Terminated: ok {rc=0} 16:52:04.751800 run mk-remote-dir(pid=24492): Launched 16:52:05.933409 run mk-remote-dir(pid=24492): Terminated: ok {rc=0} 16:52:06.226534 run scp-inst-to-remote(pid=24493): Launched 16:52:08.411873 run scp-inst-to-remote(pid=24493): Terminated: ok {rc=0} 16:52:08.773925 run rm-remote-dir(pid=24495): Launched 16:52:09.967238 run rm-remote-dir(pid=24495): Terminated: ok {rc=0} 16:52:10.329843 run mk-remote-dir(pid=24496): Launched 16:52:11.524083 run mk-remote-dir(pid=24496): Terminated: ok {rc=0} 16:52:11.833226 run scp-cfg-to-remote(pid=24497): Launched 16:52:13.023380 run scp-cfg-to-remote(pid=24497): Terminated: ok {rc=0} 16:52:13.331258 run scp-db-to-remote(pid=24499): Launched 16:52:14.518430 run scp-db-to-remote(pid=24499): Terminated: ok {rc=0} 16:52:14.651287 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:52:14.961679 run patchelf(pid=24501): Launched 16:52:16.141473 run patchelf(pid=24501): Terminated: ok {rc=0} 16:52:16.278629 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:52:16.599933 run setcap-netadm(pid=24502): Launched 16:52:17.835876 run setcap-netadm(pid=24502): Terminated: ok {rc=0} 16:52:18.160927 run srsepc(pid=24503): Launched 16:52:18.278411 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:52:19.386868 run rm-remote-dir(pid=24504): Launched 16:52:19.567248 run srsepc(pid=24503): ERR: Terminated: ERROR {rc=127} [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24503)] 16:52:19.703911 run srsepc(pid=24503): stdout: | (launched: 2022-12-09_16:52:18.104081) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:52:19.839669 run srsepc(pid=24503): stderr: | (launched: 2022-12-09_16:52:18.149773) | Connection to 10.42.42.116 closed. 16:52:19.976003 run srsepc(pid=24503): stdout: | (launched: 2022-12-09_16:52:18.104081) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:52:20.106644 run srsepc(pid=24503): stderr: | (launched: 2022-12-09_16:52:18.149773) | Connection to 10.42.42.116 closed. 16:52:20.260830 run rm-remote-dir(pid=24504): Terminating (SIGINT) 16:52:20.440141 run rm-remote-dir(pid=24504): Terminated: ok {rc=0} 16:52:20.568851 tst handover.py:37: ERR: Error: srsepc(pid=24503): Process ended prematurely: srsepc(pid=24503) [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24503)] [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 16:52:20.578794 tst handover.py:37: Test FAILED (19.9 sec) 16:52:20.655821 run scp-back-log(pid=24505): Launched 16:52:21.734297 run scp-back-log(pid=24505): ERR: Terminated: ERROR {rc=1} [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24505)] 16:52:21.794710 run scp-back-log(pid=24505): stdout: | (launched: 2022-12-09_16:52:20.625450) 16:52:21.856598 run scp-back-log(pid=24505): stderr: | (launched: 2022-12-09_16:52:20.645187) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:52:21.926272 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24505): launch_sync(): local process exited with status 1 [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24505)]') ---------------------------------------------- trial-2361 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 16:52:21.971381 tst iperf3_bidir.py:13: Number of physical ue: 1 16:52:22.179060 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:52:22.220477 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 16:52:22.424639 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:52:22.440397 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:52:22.472204 tst iperf3_bidir.py: using MSISDN 7286 16:52:22.582536 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7286', subscriber_id=0} 16:52:22.689381 run srsepc_10.42.42.118: Starting srsepc 16:52:23.318547 run rm-remote-dir(pid=24507): Launched 16:52:24.506097 run rm-remote-dir(pid=24507): Terminated: ok {rc=0} 16:52:24.867822 run mk-remote-dir(pid=24508): Launched 16:52:26.060014 run mk-remote-dir(pid=24508): Terminated: ok {rc=0} 16:52:26.368300 run scp-inst-to-remote(pid=24509): Launched 16:52:28.561208 run scp-inst-to-remote(pid=24509): Terminated: ok {rc=0} 16:52:28.921341 run rm-remote-dir(pid=24511): Launched 16:52:30.113778 run rm-remote-dir(pid=24511): Terminated: ok {rc=0} 16:52:30.475747 run mk-remote-dir(pid=24512): Launched 16:52:31.679997 run mk-remote-dir(pid=24512): Terminated: ok {rc=0} 16:52:31.974821 run scp-cfg-to-remote(pid=24513): Launched 16:52:33.228543 run scp-cfg-to-remote(pid=24513): Terminated: ok {rc=0} 16:52:33.510014 run scp-db-to-remote(pid=24515): Launched 16:52:34.686365 run scp-db-to-remote(pid=24515): Terminated: ok {rc=0} 16:52:34.816381 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:52:35.120015 run patchelf(pid=24517): Launched 16:52:36.296334 run patchelf(pid=24517): Terminated: ok {rc=0} 16:52:36.426265 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:52:36.730350 run setcap-netadm(pid=24519): Launched 16:52:37.906757 run setcap-netadm(pid=24519): Terminated: ok {rc=0} 16:52:38.224713 run srsepc(pid=24520): Launched 16:52:38.338300 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:52:39.427168 run rm-remote-dir(pid=24521): Launched 16:52:39.603598 run srsepc(pid=24520): ERR: Terminated: ERROR {rc=127} [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24520)] 16:52:39.737974 run srsepc(pid=24520): stdout: | (launched: 2022-12-09_16:52:38.169568) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:52:39.871378 run srsepc(pid=24520): stderr: | (launched: 2022-12-09_16:52:38.214469) | Connection to 10.42.42.116 closed. 16:52:40.004161 run srsepc(pid=24520): stdout: | (launched: 2022-12-09_16:52:38.169568) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:52:40.131812 run srsepc(pid=24520): stderr: | (launched: 2022-12-09_16:52:38.214469) | Connection to 10.42.42.116 closed. 16:52:40.283190 run rm-remote-dir(pid=24521): Terminating (SIGINT) 16:52:40.458718 run rm-remote-dir(pid=24521): Terminated: ok {rc=0} 16:52:40.584907 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=24520): Process ended prematurely: srsepc(pid=24520) [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24520)] [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 16:52:40.594735 tst iperf3_bidir.py:42: Test FAILED (18.6 sec) 16:52:40.670900 run scp-back-log(pid=24522): Launched 16:52:41.746199 run scp-back-log(pid=24522): ERR: Terminated: ERROR {rc=1} [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24522)] 16:52:41.806299 run scp-back-log(pid=24522): stdout: | (launched: 2022-12-09_16:52:40.640726) 16:52:41.868116 run scp-back-log(pid=24522): stderr: | (launched: 2022-12-09_16:52:40.660387) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:52:41.937677 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24522): launch_sync(): local process exited with status 1 [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24522)]') ---------------------------------------------- trial-2361 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 16:52:41.982045 tst iperf3_dl.py:13: Number of physical ue: 1 16:52:42.184700 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:52:42.232896 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 16:52:42.433595 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:52:42.449335 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:52:42.479890 tst iperf3_dl.py: using MSISDN 7287 16:52:42.600201 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7287', subscriber_id=0} 16:52:42.715006 run srsepc_10.42.42.118: Starting srsepc 16:52:43.380458 run rm-remote-dir(pid=24524): Launched 16:52:44.573365 run rm-remote-dir(pid=24524): Terminated: ok {rc=0} 16:52:44.923640 run mk-remote-dir(pid=24525): Launched 16:52:46.108926 run mk-remote-dir(pid=24525): Terminated: ok {rc=0} 16:52:46.423183 run scp-inst-to-remote(pid=24526): Launched 16:52:48.678255 run scp-inst-to-remote(pid=24526): Terminated: ok {rc=0} 16:52:49.004336 run rm-remote-dir(pid=24528): Launched 16:52:50.180732 run rm-remote-dir(pid=24528): Terminated: ok {rc=0} 16:52:50.507630 run mk-remote-dir(pid=24529): Launched 16:52:51.683725 run mk-remote-dir(pid=24529): Terminated: ok {rc=0} 16:52:51.962051 run scp-cfg-to-remote(pid=24530): Launched 16:52:53.135870 run scp-cfg-to-remote(pid=24530): Terminated: ok {rc=0} 16:52:53.413529 run scp-db-to-remote(pid=24532): Launched 16:52:54.587861 run scp-db-to-remote(pid=24532): Terminated: ok {rc=0} 16:52:54.715711 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:52:55.015727 run patchelf(pid=24534): Launched 16:52:56.189607 run patchelf(pid=24534): Terminated: ok {rc=0} 16:52:56.317829 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:52:56.617577 run setcap-netadm(pid=24535): Launched 16:52:57.790070 run setcap-netadm(pid=24535): Terminated: ok {rc=0} 16:52:58.105364 run srsepc(pid=24536): Launched 16:52:58.217627 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:52:59.293077 run rm-remote-dir(pid=24537): Launched 16:52:59.468127 run srsepc(pid=24536): ERR: Terminated: ERROR {rc=127} [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24536)] 16:52:59.599758 run srsepc(pid=24536): stdout: | (launched: 2022-12-09_16:52:58.050458) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:52:59.731725 run srsepc(pid=24536): stderr: | (launched: 2022-12-09_16:52:58.095063) | Connection to 10.42.42.116 closed. 16:52:59.863330 run srsepc(pid=24536): stdout: | (launched: 2022-12-09_16:52:58.050458) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:52:59.989458 run srsepc(pid=24536): stderr: | (launched: 2022-12-09_16:52:58.095063) | Connection to 10.42.42.116 closed. 16:53:00.138593 run rm-remote-dir(pid=24537): Terminating (SIGINT) 16:53:00.311992 run rm-remote-dir(pid=24537): Terminated: ok {rc=0} 16:53:00.437074 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=24536): Process ended prematurely: srsepc(pid=24536) [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24536)] [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 16:53:00.446665 tst iperf3_dl.py:42: Test FAILED (18.5 sec) 16:53:00.521938 run scp-back-log(pid=24538): Launched 16:53:01.604017 run scp-back-log(pid=24538): ERR: Terminated: ERROR {rc=1} [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24538)] 16:53:01.681579 run scp-back-log(pid=24538): stdout: | (launched: 2022-12-09_16:53:00.492491) 16:53:01.757657 run scp-back-log(pid=24538): stderr: | (launched: 2022-12-09_16:53:00.512090) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:53:01.852735 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24538): launch_sync(): local process exited with status 1 [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24538)]') ---------------------------------------------- trial-2361 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 16:53:01.915743 tst iperf3_ul.py:13: Number of physical ue: 1 16:53:02.234059 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:53:02.282506 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 16:53:02.532923 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:53:02.552095 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:53:02.585301 tst iperf3_ul.py: using MSISDN 7288 16:53:02.730026 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7288', subscriber_id=0} 16:53:02.851994 run srsepc_10.42.42.118: Starting srsepc 16:53:03.624897 run rm-remote-dir(pid=24645): Launched 16:53:04.916937 run rm-remote-dir(pid=24645): Terminated: ok {rc=0} 16:53:05.263641 run mk-remote-dir(pid=24810): Launched 16:53:06.502184 run mk-remote-dir(pid=24810): Terminated: ok {rc=0} 16:53:06.824723 run scp-inst-to-remote(pid=24813): Launched 16:53:09.054599 run scp-inst-to-remote(pid=24813): Terminated: ok {rc=0} 16:53:09.399225 run rm-remote-dir(pid=24815): Launched 16:53:10.638351 run rm-remote-dir(pid=24815): Terminated: ok {rc=0} 16:53:10.985438 run mk-remote-dir(pid=24816): Launched 16:53:12.223133 run mk-remote-dir(pid=24816): Terminated: ok {rc=0} 16:53:12.519235 run scp-cfg-to-remote(pid=24817): Launched 16:53:13.763840 run scp-cfg-to-remote(pid=24817): Terminated: ok {rc=0} 16:53:14.058713 run scp-db-to-remote(pid=24819): Launched 16:53:15.305371 run scp-db-to-remote(pid=24819): Terminated: ok {rc=0} 16:53:15.442468 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:53:15.766119 run patchelf(pid=24821): Launched 16:53:17.110506 run patchelf(pid=24821): Terminated: ok {rc=0} 16:53:17.314958 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:53:17.657441 run setcap-netadm(pid=24822): Launched 16:53:18.866273 run setcap-netadm(pid=24822): Terminated: ok {rc=0} 16:53:19.199759 run srsepc(pid=24823): Launched 16:53:19.375891 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:53:20.581028 run rm-remote-dir(pid=24824): Launched 16:53:20.876734 run srsepc(pid=24823): ERR: Terminated: ERROR {rc=127} [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24823)] 16:53:21.028908 run srsepc(pid=24823): stdout: | (launched: 2022-12-09_16:53:19.141451) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:53:21.169488 run srsepc(pid=24823): stderr: | (launched: 2022-12-09_16:53:19.188891) | Connection to 10.42.42.116 closed. 16:53:21.308469 run srsepc(pid=24823): stdout: | (launched: 2022-12-09_16:53:19.141451) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:53:21.443361 run srsepc(pid=24823): stderr: | (launched: 2022-12-09_16:53:19.188891) | Connection to 10.42.42.116 closed. 16:53:21.602865 run rm-remote-dir(pid=24824): Terminating (SIGINT) 16:53:21.787600 run rm-remote-dir(pid=24824): Terminated: ok {rc=0} 16:53:21.920103 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=24823): Process ended prematurely: srsepc(pid=24823) [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24823)] [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 16:53:21.931458 tst iperf3_ul.py:42: Test FAILED (20.0 sec) 16:53:22.011693 run scp-back-log(pid=24825): Launched 16:53:23.127377 run scp-back-log(pid=24825): ERR: Terminated: ERROR {rc=1} [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24825)] 16:53:23.191350 run scp-back-log(pid=24825): stdout: | (launched: 2022-12-09_16:53:21.980731) 16:53:23.256270 run scp-back-log(pid=24825): stderr: | (launched: 2022-12-09_16:53:22.000834) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:53:23.328219 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24825): launch_sync(): local process exited with status 1 [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24825)]') ---------------------------------------------- trial-2361 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 16:53:23.377556 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:53:23.395394 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:53:23.419479 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:53:23.469853 tst ping.py: using MSISDN 7289 16:53:23.589914 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7289', subscriber_id=0} 16:53:23.702046 run srsepc_10.42.42.118: Starting srsepc 16:53:24.344182 run rm-remote-dir(pid=24829): Launched 16:53:25.528286 run rm-remote-dir(pid=24829): Terminated: ok {rc=0} 16:53:25.865396 run mk-remote-dir(pid=24830): Launched 16:53:27.046646 run mk-remote-dir(pid=24830): Terminated: ok {rc=0} 16:53:27.333069 run scp-inst-to-remote(pid=24831): Launched 16:53:29.514615 run scp-inst-to-remote(pid=24831): Terminated: ok {rc=0} 16:53:29.850490 run rm-remote-dir(pid=24833): Launched 16:53:31.034726 run rm-remote-dir(pid=24833): Terminated: ok {rc=0} 16:53:31.381509 run mk-remote-dir(pid=24834): Launched 16:53:32.621216 run mk-remote-dir(pid=24834): Terminated: ok {rc=0} 16:53:32.907208 run scp-cfg-to-remote(pid=24835): Launched 16:53:34.086150 run scp-cfg-to-remote(pid=24835): Terminated: ok {rc=0} 16:53:34.370403 run scp-db-to-remote(pid=24837): Launched 16:53:35.549918 run scp-db-to-remote(pid=24837): Terminated: ok {rc=0} 16:53:35.681432 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:53:35.991279 run patchelf(pid=24839): Launched 16:53:37.169530 run patchelf(pid=24839): Terminated: ok {rc=0} 16:53:37.301163 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:53:37.610147 run setcap-netadm(pid=24840): Launched 16:53:38.788502 run setcap-netadm(pid=24840): Terminated: ok {rc=0} 16:53:39.111636 run srsepc(pid=24841): Launched 16:53:39.227824 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:53:40.334900 run rm-remote-dir(pid=24842): Launched 16:53:40.514287 run srsepc(pid=24841): ERR: Terminated: ERROR {rc=127} [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24841)] 16:53:40.650691 run srsepc(pid=24841): stdout: | (launched: 2022-12-09_16:53:39.055637) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:53:40.786398 run srsepc(pid=24841): stderr: | (launched: 2022-12-09_16:53:39.101187) | Connection to 10.42.42.116 closed. 16:53:40.921821 run srsepc(pid=24841): stdout: | (launched: 2022-12-09_16:53:39.055637) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:53:41.052156 run srsepc(pid=24841): stderr: | (launched: 2022-12-09_16:53:39.101187) | Connection to 10.42.42.116 closed. 16:53:41.205974 run rm-remote-dir(pid=24842): Terminating (SIGINT) 16:53:41.384347 run rm-remote-dir(pid=24842): Terminated: ok {rc=0} 16:53:41.512597 tst ping.py:16: ERR: Error: srsepc(pid=24841): Process ended prematurely: srsepc(pid=24841) [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24841)] [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 16:53:41.522397 tst ping.py:16: Test FAILED (18.1 sec) 16:53:41.598705 run scp-back-log(pid=24843): Launched 16:53:42.677185 run scp-back-log(pid=24843): ERR: Terminated: ERROR {rc=1} [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24843)] 16:53:42.737782 run scp-back-log(pid=24843): stdout: | (launched: 2022-12-09_16:53:41.568677) 16:53:42.799540 run scp-back-log(pid=24843): stderr: | (launched: 2022-12-09_16:53:41.588324) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:53:42.869401 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24843): launch_sync(): local process exited with status 1 [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24843)]') ---------------------------------------------- trial-2361 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 16:53:42.914272 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:53:42.930833 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:53:42.953626 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:53:43.002839 tst rrc_idle_mo_ping.py: using MSISDN 7290 16:53:43.116306 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7290', subscriber_id=0} 16:53:43.222654 run srsepc_10.42.42.118: Starting srsepc 16:53:43.845907 run rm-remote-dir(pid=24846): Launched 16:53:45.027736 run rm-remote-dir(pid=24846): Terminated: ok {rc=0} 16:53:45.364668 run mk-remote-dir(pid=24847): Launched 16:53:46.567726 run mk-remote-dir(pid=24847): Terminated: ok {rc=0} 16:53:46.912903 run scp-inst-to-remote(pid=24848): Launched 16:53:49.135190 run scp-inst-to-remote(pid=24848): Terminated: ok {rc=0} 16:53:49.494776 run rm-remote-dir(pid=24850): Launched 16:53:50.687023 run rm-remote-dir(pid=24850): Terminated: ok {rc=0} 16:53:51.047019 run mk-remote-dir(pid=24851): Launched 16:53:52.240768 run mk-remote-dir(pid=24851): Terminated: ok {rc=0} 16:53:52.548803 run scp-cfg-to-remote(pid=24852): Launched 16:53:53.737735 run scp-cfg-to-remote(pid=24852): Terminated: ok {rc=0} 16:53:54.044427 run scp-db-to-remote(pid=24854): Launched 16:53:55.235134 run scp-db-to-remote(pid=24854): Terminated: ok {rc=0} 16:53:55.376510 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:53:55.707508 run patchelf(pid=24856): Launched 16:53:56.897026 run patchelf(pid=24856): Terminated: ok {rc=0} 16:53:57.038684 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:53:57.371527 run setcap-netadm(pid=24857): Launched 16:53:58.561893 run setcap-netadm(pid=24857): Terminated: ok {rc=0} 16:53:58.909216 run srsepc(pid=24858): Launched 16:53:59.033166 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:54:00.219839 run rm-remote-dir(pid=24859): Launched 16:54:00.410722 run srsepc(pid=24858): ERR: Terminated: ERROR {rc=127} [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24858)] 16:54:00.555770 run srsepc(pid=24858): stdout: | (launched: 2022-12-09_16:53:58.849578) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:54:00.700909 run srsepc(pid=24858): stderr: | (launched: 2022-12-09_16:53:58.898459) | Connection to 10.42.42.116 closed. 16:54:00.846138 run srsepc(pid=24858): stdout: | (launched: 2022-12-09_16:53:58.849578) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:54:00.997112 run srsepc(pid=24858): stderr: | (launched: 2022-12-09_16:53:58.898459) | Connection to 10.42.42.116 closed. 16:54:01.165773 run rm-remote-dir(pid=24859): Terminating (SIGINT) 16:54:01.360599 run rm-remote-dir(pid=24859): Terminated: ok {rc=0} 16:54:01.501949 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=24858): Process ended prematurely: srsepc(pid=24858) [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24858)] [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 16:54:01.513592 tst rrc_idle_mo_ping.py:16: Test FAILED (18.6 sec) 16:54:01.600474 run scp-back-log(pid=24860): Launched 16:54:02.718336 run scp-back-log(pid=24860): ERR: Terminated: ERROR {rc=1} [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24860)] 16:54:02.778764 run scp-back-log(pid=24860): stdout: | (launched: 2022-12-09_16:54:01.566337) 16:54:02.840790 run scp-back-log(pid=24860): stderr: | (launched: 2022-12-09_16:54:01.587233) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:54:02.910689 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24860): launch_sync(): local process exited with status 1 [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24860)]') ---------------------------------------------- trial-2361 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 16:54:02.956124 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 16:54:02.972807 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 16:54:02.995613 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 16:54:03.043462 tst rrc_idle_mt_ping.py: using MSISDN 7291 16:54:03.157646 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7291', subscriber_id=0} 16:54:03.264111 run srsepc_10.42.42.118: Starting srsepc 16:54:03.889314 run rm-remote-dir(pid=24862): Launched 16:54:05.071630 run rm-remote-dir(pid=24862): Terminated: ok {rc=0} 16:54:05.408579 run mk-remote-dir(pid=24863): Launched 16:54:06.588845 run mk-remote-dir(pid=24863): Terminated: ok {rc=0} 16:54:06.875375 run scp-inst-to-remote(pid=24864): Launched 16:54:09.056870 run scp-inst-to-remote(pid=24864): Terminated: ok {rc=0} 16:54:09.392701 run rm-remote-dir(pid=24866): Launched 16:54:10.574707 run rm-remote-dir(pid=24866): Terminated: ok {rc=0} 16:54:10.910953 run mk-remote-dir(pid=24868): Launched 16:54:12.092451 run mk-remote-dir(pid=24868): Terminated: ok {rc=0} 16:54:12.379097 run scp-cfg-to-remote(pid=24869): Launched 16:54:13.558699 run scp-cfg-to-remote(pid=24869): Terminated: ok {rc=0} 16:54:13.843304 run scp-db-to-remote(pid=24871): Launched 16:54:15.022385 run scp-db-to-remote(pid=24871): Terminated: ok {rc=0} 16:54:15.153837 run srsepc_10.42.42.118: Setting RPATH for srsepc 16:54:15.462506 run patchelf(pid=24873): Launched 16:54:16.644652 run patchelf(pid=24873): Terminated: ok {rc=0} 16:54:16.789507 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 16:54:17.126814 run setcap-netadm(pid=24874): Launched 16:54:18.335700 run setcap-netadm(pid=24874): Terminated: ok {rc=0} 16:54:18.683191 run srsepc(pid=24875): Launched 16:54:18.805421 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 16:54:19.995071 run rm-remote-dir(pid=24876): Launched 16:54:20.184472 run srsepc(pid=24875): ERR: Terminated: ERROR {rc=127} [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24875)] 16:54:20.328034 run srsepc(pid=24875): stdout: | (launched: 2022-12-09_16:54:18.623090) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:54:20.472373 run srsepc(pid=24875): stderr: | (launched: 2022-12-09_16:54:18.672092) | Connection to 10.42.42.116 closed. 16:54:20.617050 run srsepc(pid=24875): stdout: | (launched: 2022-12-09_16:54:18.623090) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 16:54:20.755619 run srsepc(pid=24875): stderr: | (launched: 2022-12-09_16:54:18.672092) | Connection to 10.42.42.116 closed. 16:54:20.919673 run rm-remote-dir(pid=24876): Terminating (SIGINT) 16:54:21.109372 run rm-remote-dir(pid=24876): Terminated: ok {rc=0} 16:54:21.246297 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=24875): Process ended prematurely: srsepc(pid=24875) [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24875)] [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 16:54:21.256638 tst rrc_idle_mt_ping.py:16: Test FAILED (18.3 sec) 16:54:21.336613 run scp-back-log(pid=24877): Launched 16:54:22.415577 run scp-back-log(pid=24877): ERR: Terminated: ERROR {rc=1} [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24877)] 16:54:22.478502 run scp-back-log(pid=24877): stdout: | (launched: 2022-12-09_16:54:21.305291) 16:54:22.543376 run scp-back-log(pid=24877): stderr: | (launched: 2022-12-09_16:54:21.325815) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 16:54:22.616188 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24877): launch_sync(): local process exited with status 1 [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24877)]') --------------------------------------------------------------------- trial-2361 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 16:54:22.748561 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:54:22.754116 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 16:54:22.796798 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 16:54:22.823994 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 16:54:22.878377 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 16:54:22.921966 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 16:54:22.948279 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 16:54:23.499178 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 16:54:23.505161 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:54:23.516505 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 16:54:23.556691 tst handover.py: using LAC 22414 16:54:23.686168 tst handover.py: using RAC 229 16:54:23.812794 tst handover.py: using CellId 22414 16:54:23.939661 tst handover.py: using BVCI 22415 16:54:24.057391 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 16:54:24.096719 tst handover.py: using LAC 22415 16:54:24.224259 tst handover.py: using RAC 230 16:54:24.349706 tst handover.py: using CellId 22415 16:54:24.474897 tst handover.py: using BVCI 22416 16:54:24.594482 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:54:24.605884 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:54:24.616862 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:54:24.628332 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:54:24.639892 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 16:54:24.651228 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 16:54:24.769876 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 16:54:24.885562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:25.355048 run create_hlr_db(pid=24882): Launched 16:54:26.523748 run create_hlr_db(pid=24882): Terminated: ok {rc=0} 16:54:26.843736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24884): Launched 16:54:27.147461 run osmo-hlr_10.42.42.2(pid=24885): Launched 16:54:27.262622 run osmo-stp_10.42.42.5: Starting osmo-stp 16:54:27.798087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24887): Launched 16:54:28.101431 run osmo-stp_10.42.42.5(pid=24888): Launched 16:54:28.217868 run osmo-msc_10.42.42.6: Starting osmo-msc 16:54:28.764843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24890): Launched 16:54:29.067778 run osmo-msc_10.42.42.6(pid=24891): Launched 16:54:29.235953 run osmo-stp_10.42.42.5(pid=24888): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24888)] 16:54:29.363066 run osmo-stp_10.42.42.5(pid=24888): stdout: | (launched: 2022-12-09_16:54:28.045732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:29.490214 run osmo-stp_10.42.42.5(pid=24888): stderr: | [0;m[38;5;43m20221209165428219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165428219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165428219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165428220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165428220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165428220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165428220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:29.616120 run osmo-stp_10.42.42.5(pid=24888): stdout: | (launched: 2022-12-09_16:54:28.045732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:29.737093 run osmo-stp_10.42.42.5(pid=24888): stderr: | [0;m[38;5;43m20221209165428219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165428219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165428219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165428220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165428220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165428220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165428220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:29.881454 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24888): Process ended prematurely: osmo-stp_10.42.42.5(pid=24888) [trial-2361↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24888)] [trial-2361↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 16:54:29.889532 tst handover.py:18: Test FAILED (6.4 sec) 16:54:29.915283 run osmo-hlr_10.42.42.2(pid=24885): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24885)] 16:54:29.962139 run osmo-hlr_10.42.42.2(pid=24885): stdout: | (launched: 2022-12-09_16:54:27.092018) 16:54:30.010820 run osmo-hlr_10.42.42.2(pid=24885): stderr: | [0;m[1;31m20221209165427269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165427269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165427269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165427270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165427270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165427270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165427283 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165427291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165427292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165427292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:30.079203 run osmo-msc_10.42.42.6(pid=24891): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24891)] 16:54:30.126177 run osmo-msc_10.42.42.6(pid=24891): stdout: | (launched: 2022-12-09_16:54:29.011935) 16:54:30.174834 run osmo-msc_10.42.42.6(pid=24891): stderr: | [0;m[38;5;43m20221209165429285 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165429285 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd8f7741c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165429285 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165429285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165429286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165429286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165429287 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165429289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165429289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165429289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:30.223616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24884): Terminating (SIGTERM) 16:54:30.262501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24887): Terminating (SIGTERM) 16:54:30.301474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24890): Terminating (SIGTERM) 16:54:30.340865 --- ParallelTerminationStrategy: PID 24884 died... 16:54:30.359518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24884): Terminated: ok {rc=0} 16:54:30.403160 --- ParallelTerminationStrategy: PID 24887 died... 16:54:30.421589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24887): Terminated: ok {rc=0} 16:54:30.464791 --- ParallelTerminationStrategy: PID 24890 died... 16:54:30.483296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24890): Terminated: ok {rc=0} 16:54:30.567964 bus /sierra_3: Setting Powered False 16:54:31.667775 bus /sierra_3: Setting Powered False 16:54:32.780532 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 16:54:34.026654 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:54:34.032071 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 16:54:34.075349 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 16:54:34.103648 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 16:54:34.157139 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 16:54:34.198619 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 16:54:34.226745 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 16:54:34.775501 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 16:54:34.781783 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:54:34.793156 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 16:54:34.831043 tst handover.py: using LAC 22416 16:54:34.955359 tst handover.py: using RAC 231 16:54:35.084147 tst handover.py: using CellId 22416 16:54:35.211614 tst handover.py: using BVCI 22417 16:54:35.330044 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 16:54:35.364084 tst handover.py: using LAC 22417 16:54:35.490644 tst handover.py: using RAC 232 16:54:35.617202 tst handover.py: using CellId 22417 16:54:35.743476 tst handover.py: using BVCI 22418 16:54:35.861720 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:54:35.873033 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:54:35.884112 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:54:35.895458 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:54:35.907045 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:54:35.918334 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 16:54:36.037916 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 16:54:36.154750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:36.598384 run create_hlr_db(pid=24897): Launched 16:54:36.715662 bus /sierra_2: Setting Powered False 16:54:37.775619 run create_hlr_db(pid=24897): Terminated: ok {rc=0} 16:54:38.172750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24899): Launched 16:54:38.477194 run osmo-hlr_10.42.42.2(pid=24900): Launched 16:54:38.593720 run osmo-stp_10.42.42.5: Starting osmo-stp 16:54:39.104863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24902): Launched 16:54:39.409094 run osmo-stp_10.42.42.5(pid=24903): Launched 16:54:39.525844 run osmo-msc_10.42.42.6: Starting osmo-msc 16:54:40.049732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24905): Launched 16:54:40.355095 run osmo-msc_10.42.42.6(pid=24906): Launched 16:54:40.525847 run osmo-stp_10.42.42.5(pid=24903): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24903)] 16:54:40.655834 run osmo-stp_10.42.42.5(pid=24903): stdout: | (launched: 2022-12-09_16:54:39.353070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:40.784133 run osmo-stp_10.42.42.5(pid=24903): stderr: | [0;m[38;5;43m20221209165439524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165439524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165439524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165439525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165439525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165439525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165439525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:40.910718 run osmo-stp_10.42.42.5(pid=24903): stdout: | (launched: 2022-12-09_16:54:39.353070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:41.031864 run osmo-stp_10.42.42.5(pid=24903): stderr: | [0;m[38;5;43m20221209165439524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165439524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165439524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165439525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165439525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165439525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165439525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:41.177464 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24903): Process ended prematurely: osmo-stp_10.42.42.5(pid=24903) [trial-2361↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24903)] [trial-2361↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 16:54:41.185988 tst handover.py:18: Test FAILED (6.4 sec) 16:54:41.211777 run osmo-hlr_10.42.42.2(pid=24900): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24900)] 16:54:41.258952 run osmo-hlr_10.42.42.2(pid=24900): stdout: | (launched: 2022-12-09_16:54:38.421375) 16:54:41.307764 run osmo-hlr_10.42.42.2(pid=24900): stderr: | [0;m[1;31m20221209165438599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165438599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165438599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165438599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165438599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165438599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165438616 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165438626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165438626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165438626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:41.375731 run osmo-msc_10.42.42.6(pid=24906): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24906)] 16:54:41.422906 run osmo-msc_10.42.42.6(pid=24906): stdout: | (launched: 2022-12-09_16:54:40.299117) 16:54:41.471313 run osmo-msc_10.42.42.6(pid=24906): stderr: | [0;m[38;5;43m20221209165440570 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165440570 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f04708adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165440570 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165440570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165440570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165440571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165440572 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165440573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165440573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165440573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:41.519969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24899): Terminating (SIGTERM) 16:54:41.558913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24902): Terminating (SIGTERM) 16:54:41.598016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24905): Terminating (SIGTERM) 16:54:41.637618 --- ParallelTerminationStrategy: PID 24899 died... 16:54:41.656312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24899): Terminated: ok {rc=0} 16:54:41.700412 --- ParallelTerminationStrategy: PID 24902 died... 16:54:41.718898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24902): Terminated: ok {rc=0} 16:54:41.762336 --- ParallelTerminationStrategy: PID 24905 died... 16:54:41.780694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24905): Terminated: ok {rc=0} 16:54:41.864204 bus /sierra_3: Setting Powered False 16:54:42.959285 bus /sierra_3: Setting Powered False 16:54:44.074280 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 16:54:45.317363 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:54:45.322220 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 16:54:45.376063 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 16:54:45.402990 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 16:54:45.458583 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 16:54:45.517304 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 16:54:45.545275 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 16:54:46.103687 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 16:54:46.112563 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:54:46.128084 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:54:46.176725 tst handover.py: using LAC 22418 16:54:46.306377 tst handover.py: using RAC 233 16:54:46.435734 tst handover.py: using CellId 22418 16:54:46.605708 tst handover.py: using BVCI 22419 16:54:46.749451 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:54:46.798619 tst handover.py: using LAC 22419 16:54:46.952298 tst handover.py: using RAC 234 16:54:47.108109 tst handover.py: using CellId 22419 16:54:47.258994 tst handover.py: using BVCI 22420 16:54:47.385349 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:54:47.396712 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:54:47.408146 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:54:47.419964 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:54:47.431727 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:54:47.443242 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:54:47.559963 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:54:47.675791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:48.121708 run create_hlr_db(pid=24912): Launched 16:54:48.245815 bus /sierra_2: Setting Powered False 16:54:49.306592 run create_hlr_db(pid=24912): Terminated: ok {rc=0} 16:54:49.723121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24914): Launched 16:54:50.049140 run osmo-hlr_10.42.42.2(pid=24915): Launched 16:54:50.174637 run osmo-stp_10.42.42.5: Starting osmo-stp 16:54:50.706482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24917): Launched 16:54:51.032511 run osmo-stp_10.42.42.5(pid=24918): Launched 16:54:51.157126 run osmo-msc_10.42.42.6: Starting osmo-msc 16:54:51.718790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24920): Launched 16:54:52.045680 run osmo-msc_10.42.42.6(pid=24921): Launched 16:54:52.227499 run osmo-stp_10.42.42.5(pid=24918): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24918)] 16:54:52.365541 run osmo-stp_10.42.42.5(pid=24918): stdout: | (launched: 2022-12-09_16:54:50.973279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:52.504324 run osmo-stp_10.42.42.5(pid=24918): stderr: | [0;m[38;5;43m20221209165451166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165451166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165451166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165451167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165451167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165451167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165451167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:52.641360 run osmo-stp_10.42.42.5(pid=24918): stdout: | (launched: 2022-12-09_16:54:50.973279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:52.771770 run osmo-stp_10.42.42.5(pid=24918): stderr: | [0;m[38;5;43m20221209165451166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165451166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165451166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165451167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165451167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165451167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165451167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:52.927837 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24918): Process ended prematurely: osmo-stp_10.42.42.5(pid=24918) [trial-2361↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24918)] [trial-2361↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 16:54:52.936711 tst handover.py:18: Test FAILED (6.8 sec) 16:54:52.964431 run osmo-hlr_10.42.42.2(pid=24915): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24915)] 16:54:53.015036 run osmo-hlr_10.42.42.2(pid=24915): stdout: | (launched: 2022-12-09_16:54:49.989784) 16:54:53.067070 run osmo-hlr_10.42.42.2(pid=24915): stderr: | [0;m[1;31m20221209165450190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165450190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165450190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165450190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165450190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165450190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165450224 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165450235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165450235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165450235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:53.139245 run osmo-msc_10.42.42.6(pid=24921): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24921)] 16:54:53.189116 run osmo-msc_10.42.42.6(pid=24921): stdout: | (launched: 2022-12-09_16:54:51.985890) 16:54:53.240085 run osmo-msc_10.42.42.6(pid=24921): stderr: | [0;m[38;5;43m20221209165452306 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165452306 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff3d38ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165452307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165452307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165452307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165452307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165452309 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165452309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165452309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165452309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:53.291935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24914): Terminating (SIGTERM) 16:54:53.333541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24917): Terminating (SIGTERM) 16:54:53.375342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24920): Terminating (SIGTERM) 16:54:53.417283 --- ParallelTerminationStrategy: PID 24914 died... 16:54:53.436914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24914): Terminated: ok {rc=0} 16:54:53.483271 --- ParallelTerminationStrategy: PID 24917 died... 16:54:53.503184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24917): Terminated: ok {rc=0} 16:54:53.549384 --- ParallelTerminationStrategy: PID 24920 died... 16:54:53.568631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24920): Terminated: ok {rc=0} 16:54:53.656072 bus /sierra_3: Setting Powered False 16:54:54.753107 bus /sierra_3: Setting Powered False 16:54:55.868813 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 16:54:57.127719 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:54:57.133557 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 16:54:57.185269 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:54:57.212478 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:54:57.263951 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 16:54:57.315019 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:54:57.342649 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:54:57.898185 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 16:54:57.903559 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:54:57.915037 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:54:57.955198 tst handover.py: using LAC 22420 16:54:58.081509 tst handover.py: using RAC 235 16:54:58.200805 tst handover.py: using CellId 22420 16:54:58.318641 tst handover.py: using BVCI 22421 16:54:58.429944 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:54:58.474391 tst handover.py: using LAC 22421 16:54:58.594657 tst handover.py: using RAC 236 16:54:58.712924 tst handover.py: using CellId 22421 16:54:58.830745 tst handover.py: using BVCI 22422 16:54:58.942153 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:54:58.953421 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:54:58.964724 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:54:58.976455 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:54:58.988121 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:54:58.999893 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:54:59.117614 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:54:59.238263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:59.714940 run create_hlr_db(pid=24926): Launched 16:54:59.839763 bus /sierra_2: Setting Powered False 16:55:00.918644 run create_hlr_db(pid=24926): Terminated: ok {rc=0} 16:55:01.335927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24931): Launched 16:55:01.675382 run osmo-hlr_10.42.42.2(pid=24932): Launched 16:55:01.916908 run osmo-stp_10.42.42.5: Starting osmo-stp 16:55:02.496490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24934): Launched 16:55:02.822228 run osmo-stp_10.42.42.5(pid=24935): Launched 16:55:02.946655 run osmo-msc_10.42.42.6: Starting osmo-msc 16:55:03.509128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24937): Launched 16:55:03.835367 run osmo-msc_10.42.42.6(pid=24938): Launched 16:55:04.017694 run osmo-stp_10.42.42.5(pid=24935): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24935)] 16:55:04.155181 run osmo-stp_10.42.42.5(pid=24935): stdout: | (launched: 2022-12-09_16:55:02.762990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:04.292933 run osmo-stp_10.42.42.5(pid=24935): stderr: | [0;m[38;5;43m20221209165502953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165502954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165502954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165502954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165502957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165502957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165502957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:04.430016 run osmo-stp_10.42.42.5(pid=24935): stdout: | (launched: 2022-12-09_16:55:02.762990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:04.561489 run osmo-stp_10.42.42.5(pid=24935): stderr: | [0;m[38;5;43m20221209165502953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165502954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165502954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165502954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165502957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165502957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165502957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:04.716886 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24935): Process ended prematurely: osmo-stp_10.42.42.5(pid=24935) [trial-2361↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24935)] [trial-2361↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 16:55:04.725996 tst handover.py:18: Test FAILED (6.8 sec) 16:55:04.753971 run osmo-hlr_10.42.42.2(pid=24932): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24932)] 16:55:04.804264 run osmo-hlr_10.42.42.2(pid=24932): stdout: | (launched: 2022-12-09_16:55:01.610124) 16:55:04.856173 run osmo-hlr_10.42.42.2(pid=24932): stderr: | [0;m[1;31m20221209165501924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165501924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165501924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165501924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165501924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165501924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165501959 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165501983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165501984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165501984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:55:04.927806 run osmo-msc_10.42.42.6(pid=24938): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24938)] 16:55:04.977817 run osmo-msc_10.42.42.6(pid=24938): stdout: | (launched: 2022-12-09_16:55:03.776029) 16:55:05.029282 run osmo-msc_10.42.42.6(pid=24938): stderr: | [0;m[38;5;43m20221209165504095 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165504095 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6983fb1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165504095 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165504095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165504095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165504096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165504097 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165504098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165504098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165504098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:55:05.081227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24931): Terminating (SIGTERM) 16:55:05.122955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24934): Terminating (SIGTERM) 16:55:05.164742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24937): Terminating (SIGTERM) 16:55:05.207370 --- ParallelTerminationStrategy: PID 24931 died... 16:55:05.227199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24931): Terminated: ok {rc=0} 16:55:05.273625 --- ParallelTerminationStrategy: PID 24934 died... 16:55:05.293058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24934): Terminated: ok {rc=0} 16:55:05.339301 --- ParallelTerminationStrategy: PID 24937 died... 16:55:05.358733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24937): Terminated: ok {rc=0} 16:55:05.446844 bus /sierra_3: Setting Powered False 16:55:06.546235 bus /sierra_3: Setting Powered False 16:55:07.662820 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 16:55:08.921891 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:55:08.927612 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 16:55:08.983904 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:55:09.011458 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:55:09.066679 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 16:55:09.121405 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:55:09.147667 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:55:09.700594 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 16:55:09.706007 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:55:09.717507 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:55:09.757244 tst handover.py: using LAC 22422 16:55:09.886062 tst handover.py: using RAC 237 16:55:10.016008 tst handover.py: using CellId 22422 16:55:10.142603 tst handover.py: using BVCI 22423 16:55:10.259980 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:55:10.309289 tst handover.py: using LAC 22423 16:55:10.434080 tst handover.py: using RAC 238 16:55:10.560187 tst handover.py: using CellId 22423 16:55:10.682871 tst handover.py: using BVCI 22424 16:55:10.794363 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:55:10.805708 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:55:10.816718 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:55:10.828053 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:55:10.839227 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:55:10.850398 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:55:10.969649 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:55:11.084857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:11.528770 run create_hlr_db(pid=24943): Launched 16:55:11.654166 bus /sierra_2: Setting Powered False 16:55:12.714291 run create_hlr_db(pid=24943): Terminated: ok {rc=0} 16:55:13.130806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24945): Launched 16:55:13.456364 run osmo-hlr_10.42.42.2(pid=24946): Launched 16:55:13.582445 run osmo-stp_10.42.42.5: Starting osmo-stp 16:55:14.116156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24948): Launched 16:55:14.441088 run osmo-stp_10.42.42.5(pid=24949): Launched 16:55:14.567107 run osmo-msc_10.42.42.6: Starting osmo-msc 16:55:15.128160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24951): Launched 16:55:15.453212 run osmo-msc_10.42.42.6(pid=24952): Launched 16:55:15.635653 run osmo-stp_10.42.42.5(pid=24949): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24949)] 16:55:15.773261 run osmo-stp_10.42.42.5(pid=24949): stdout: | (launched: 2022-12-09_16:55:14.381923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:15.947485 run osmo-stp_10.42.42.5(pid=24949): stderr: | [0;m[38;5;43m20221209165514575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165514575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165514575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165514576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165514576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165514576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165514576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:16.143516 run osmo-stp_10.42.42.5(pid=24949): stdout: | (launched: 2022-12-09_16:55:14.381923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:16.276449 run osmo-stp_10.42.42.5(pid=24949): stderr: | [0;m[38;5;43m20221209165514575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165514575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165514575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165514576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165514576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165514576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165514576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:16.436112 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24949): Process ended prematurely: osmo-stp_10.42.42.5(pid=24949) [trial-2361↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24949)] [trial-2361↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 16:55:16.445979 tst handover.py:18: Test FAILED (6.7 sec) 16:55:16.476241 run osmo-hlr_10.42.42.2(pid=24946): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24946)] 16:55:16.529347 run osmo-hlr_10.42.42.2(pid=24946): stdout: | (launched: 2022-12-09_16:55:13.397142) 16:55:16.584358 run osmo-hlr_10.42.42.2(pid=24946): stderr: | [0;m[1;31m20221209165513596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165513596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165513596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165513596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165513596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165513596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165513609 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165513617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165513617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165513617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:55:16.658312 run osmo-msc_10.42.42.6(pid=24952): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24952)] 16:55:16.710203 run osmo-msc_10.42.42.6(pid=24952): stdout: | (launched: 2022-12-09_16:55:15.393797) 16:55:16.763786 run osmo-msc_10.42.42.6(pid=24952): stderr: | [0;m[38;5;43m20221209165515714 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165515715 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7781ab1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165515715 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165515715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165515715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165515715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165515717 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165515717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165515717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165515717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:55:16.818226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24945): Terminating (SIGTERM) 16:55:16.861959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24948): Terminating (SIGTERM) 16:55:16.906286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24951): Terminating (SIGTERM) 16:55:16.951671 --- ParallelTerminationStrategy: PID 24945 died... 16:55:16.972157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24945): Terminated: ok {rc=0} 16:55:17.022724 --- ParallelTerminationStrategy: PID 24948 died... 16:55:17.043346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24948): Terminated: ok {rc=0} 16:55:17.093171 --- ParallelTerminationStrategy: PID 24951 died... 16:55:17.113916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24951): Terminated: ok {rc=0} 16:55:17.208766 bus /sierra_3: Setting Powered False 16:55:18.309497 bus /sierra_3: Setting Powered False 16:55:19.424712 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 16:55:20.686525 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:55:20.691580 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 16:55:20.732616 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 16:55:20.759220 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 16:55:20.811398 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 16:55:20.852722 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 16:55:20.878867 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 16:55:21.428653 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 16:55:21.433800 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:55:21.444556 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 16:55:21.481719 tst handover.py: using LAC 22424 16:55:21.604437 tst handover.py: using RAC 239 16:55:21.730894 tst handover.py: using CellId 22424 16:55:21.860036 tst handover.py: using BVCI 22425 16:55:21.978761 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 16:55:22.013760 tst handover.py: using LAC 22425 16:55:22.141193 tst handover.py: using RAC 240 16:55:22.266795 tst handover.py: using CellId 22425 16:55:22.392417 tst handover.py: using BVCI 22426 16:55:22.510742 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:55:22.522605 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:55:22.533799 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:55:22.545636 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:55:22.557352 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:55:22.569448 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 16:55:22.689633 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 16:55:22.812013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:23.286528 run create_hlr_db(pid=24957): Launched 16:55:23.411808 bus /sierra_2: Setting Powered False 16:55:24.475705 run create_hlr_db(pid=24957): Terminated: ok {rc=0} 16:55:24.900418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24959): Launched 16:55:25.225986 run osmo-hlr_10.42.42.2(pid=24960): Launched 16:55:25.350637 run osmo-stp_10.42.42.5: Starting osmo-stp 16:55:25.879564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24962): Launched 16:55:26.204482 run osmo-stp_10.42.42.5(pid=24963): Launched 16:55:26.328800 run osmo-msc_10.42.42.6: Starting osmo-msc 16:55:26.886285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24965): Launched 16:55:27.213377 run osmo-msc_10.42.42.6(pid=24966): Launched 16:55:27.395357 run osmo-stp_10.42.42.5(pid=24963): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24963)] 16:55:27.534517 run osmo-stp_10.42.42.5(pid=24963): stdout: | (launched: 2022-12-09_16:55:26.145024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:27.672146 run osmo-stp_10.42.42.5(pid=24963): stderr: | [0;m[38;5;43m20221209165526338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165526338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165526338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165526339 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165526341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165526341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165526341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:27.809142 run osmo-stp_10.42.42.5(pid=24963): stdout: | (launched: 2022-12-09_16:55:26.145024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:27.939177 run osmo-stp_10.42.42.5(pid=24963): stderr: | [0;m[38;5;43m20221209165526338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165526338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165526338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165526339 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165526341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165526341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165526341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:28.094904 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24963): Process ended prematurely: osmo-stp_10.42.42.5(pid=24963) [trial-2361↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24963)] [trial-2361↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 16:55:28.103739 tst handover.py:18: Test FAILED (6.7 sec) 16:55:28.131533 run osmo-hlr_10.42.42.2(pid=24960): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24960)] 16:55:28.181545 run osmo-hlr_10.42.42.2(pid=24960): stdout: | (launched: 2022-12-09_16:55:25.166680) 16:55:28.233494 run osmo-hlr_10.42.42.2(pid=24960): stderr: | [0;m[1;31m20221209165525366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165525366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165525366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165525366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165525366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165525366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165525378 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165525386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165525386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165525387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:55:28.305269 run osmo-msc_10.42.42.6(pid=24966): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24966)] 16:55:28.355085 run osmo-msc_10.42.42.6(pid=24966): stdout: | (launched: 2022-12-09_16:55:27.153794) 16:55:28.406560 run osmo-msc_10.42.42.6(pid=24966): stderr: | [0;m[38;5;43m20221209165527479 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165527479 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9e2d8b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165527479 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165527479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165527479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165527479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165527481 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165527481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165527482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165527482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:55:28.458684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24959): Terminating (SIGTERM) 16:55:28.500270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24962): Terminating (SIGTERM) 16:55:28.542328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24965): Terminating (SIGTERM) 16:55:28.584532 --- ParallelTerminationStrategy: PID 24959 died... 16:55:28.604324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24959): Terminated: ok {rc=0} 16:55:28.650844 --- ParallelTerminationStrategy: PID 24962 died... 16:55:28.670278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24962): Terminated: ok {rc=0} 16:55:28.716515 --- ParallelTerminationStrategy: PID 24965 died... 16:55:28.735963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24965): Terminated: ok {rc=0} 16:55:28.822638 bus /sierra_3: Setting Powered False 16:55:29.918684 bus /sierra_3: Setting Powered False 16:55:31.045077 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 16:55:32.305419 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:55:32.311447 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 16:55:32.367616 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 16:55:32.395672 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 16:55:32.447138 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 16:55:32.501946 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 16:55:32.529739 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 16:55:33.083204 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 16:55:33.088841 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:55:33.100658 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:55:33.139931 tst handover.py: using LAC 22426 16:55:33.266017 tst handover.py: using RAC 241 16:55:33.392646 tst handover.py: using CellId 22426 16:55:33.515235 tst handover.py: using BVCI 22427 16:55:33.625734 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:55:33.672433 tst handover.py: using LAC 22427 16:55:33.793493 tst handover.py: using RAC 242 16:55:33.911626 tst handover.py: using CellId 22427 16:55:34.038229 tst handover.py: using BVCI 22428 16:55:34.156031 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:55:34.167524 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:55:34.178955 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:55:34.190732 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:55:34.202665 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:55:34.214916 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:55:34.331797 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:55:34.451369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:34.928306 run create_hlr_db(pid=24971): Launched 16:55:35.051819 bus /sierra_2: Setting Powered False 16:55:36.116225 run create_hlr_db(pid=24971): Terminated: ok {rc=0} 16:55:36.524934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24973): Launched 16:55:36.832140 run osmo-hlr_10.42.42.2(pid=24974): Launched 16:55:36.949128 run osmo-stp_10.42.42.5: Starting osmo-stp 16:55:37.446165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24976): Launched 16:55:37.750976 run osmo-stp_10.42.42.5(pid=24977): Launched 16:55:37.866705 run osmo-msc_10.42.42.6: Starting osmo-msc 16:55:38.389428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24979): Launched 16:55:38.692236 run osmo-msc_10.42.42.6(pid=24980): Launched 16:55:38.862542 run osmo-stp_10.42.42.5(pid=24977): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24977)] 16:55:38.990585 run osmo-stp_10.42.42.5(pid=24977): stdout: | (launched: 2022-12-09_16:55:37.694791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:39.118504 run osmo-stp_10.42.42.5(pid=24977): stderr: | [0;m[38;5;43m20221209165537865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165537865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165537865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165537866 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165537868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165537868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165537868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:39.244107 run osmo-stp_10.42.42.5(pid=24977): stdout: | (launched: 2022-12-09_16:55:37.694791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:39.364914 run osmo-stp_10.42.42.5(pid=24977): stderr: | [0;m[38;5;43m20221209165537865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165537865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165537865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165537866 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165537868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165537868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165537868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:39.509541 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24977): Process ended prematurely: osmo-stp_10.42.42.5(pid=24977) [trial-2361↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24977)] [trial-2361↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 16:55:39.517547 tst handover.py:18: Test FAILED (6.4 sec) 16:55:39.543111 run osmo-hlr_10.42.42.2(pid=24974): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24974)] 16:55:39.589985 run osmo-hlr_10.42.42.2(pid=24974): stdout: | (launched: 2022-12-09_16:55:36.776015) 16:55:39.638343 run osmo-hlr_10.42.42.2(pid=24974): stderr: | [0;m[1;31m20221209165536951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165536951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165536951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165536951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165536952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165536952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165536964 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165536975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165536975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165536975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:55:39.705887 run osmo-msc_10.42.42.6(pid=24980): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24980)] 16:55:39.752559 run osmo-msc_10.42.42.6(pid=24980): stdout: | (launched: 2022-12-09_16:55:38.636689) 16:55:39.801148 run osmo-msc_10.42.42.6(pid=24980): stderr: | [0;m[38;5;43m20221209165538908 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165538908 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1824a09c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165538908 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165538908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165538909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165538909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165538910 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165538911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165538911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165538911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:55:39.849984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24973): Terminating (SIGTERM) 16:55:39.888811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24976): Terminating (SIGTERM) 16:55:39.927642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24979): Terminating (SIGTERM) 16:55:39.966771 --- ParallelTerminationStrategy: PID 24973 died... 16:55:39.985495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24973): Terminated: ok {rc=0} 16:55:40.028506 --- ParallelTerminationStrategy: PID 24976 died... 16:55:40.046752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24976): Terminated: ok {rc=0} 16:55:40.089649 --- ParallelTerminationStrategy: PID 24979 died... 16:55:40.107992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24979): Terminated: ok {rc=0} 16:55:40.191989 bus /sierra_3: Setting Powered False 16:55:41.290545 bus /sierra_3: Setting Powered False 16:55:42.402130 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 16:55:43.663063 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:55:43.668813 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 16:55:43.723944 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:55:43.751870 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 16:55:43.804735 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 16:55:43.859026 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:55:43.886947 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 16:55:44.438670 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 16:55:44.444481 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:55:44.456036 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:55:44.496183 tst handover.py: using LAC 22428 16:55:44.623743 tst handover.py: using RAC 243 16:55:44.751738 tst handover.py: using CellId 22428 16:55:44.878258 tst handover.py: using BVCI 22429 16:55:44.996153 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:55:45.044831 tst handover.py: using LAC 22429 16:55:45.174951 tst handover.py: using RAC 244 16:55:45.294275 tst handover.py: using CellId 22429 16:55:45.416844 tst handover.py: using BVCI 22430 16:55:45.527585 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:55:45.538524 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:55:45.549222 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:55:45.559952 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:55:45.570762 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:55:45.581530 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:55:45.700671 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:55:45.820639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:46.304901 run create_hlr_db(pid=24985): Launched 16:55:46.471788 bus /sierra_2: Setting Powered False 16:55:47.532759 run create_hlr_db(pid=24985): Terminated: ok {rc=0} 16:55:47.948027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24987): Launched 16:55:48.273087 run osmo-hlr_10.42.42.2(pid=24988): Launched 16:55:48.397676 run osmo-stp_10.42.42.5: Starting osmo-stp 16:55:48.930777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24990): Launched 16:55:49.254871 run osmo-stp_10.42.42.5(pid=24991): Launched 16:55:49.378850 run osmo-msc_10.42.42.6: Starting osmo-msc 16:55:49.937688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24993): Launched 16:55:50.262347 run osmo-msc_10.42.42.6(pid=24994): Launched 16:55:50.443612 run osmo-stp_10.42.42.5(pid=24991): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24991)] 16:55:50.581360 run osmo-stp_10.42.42.5(pid=24991): stdout: | (launched: 2022-12-09_16:55:49.195999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:50.718591 run osmo-stp_10.42.42.5(pid=24991): stderr: | [0;m[38;5;43m20221209165549390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165549390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165549390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165549391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165549391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165549391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165549391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:50.855742 run osmo-stp_10.42.42.5(pid=24991): stdout: | (launched: 2022-12-09_16:55:49.195999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:50.985550 run osmo-stp_10.42.42.5(pid=24991): stderr: | [0;m[38;5;43m20221209165549390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165549390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165549390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165549391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165549391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165549391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165549391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:51.140787 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24991): Process ended prematurely: osmo-stp_10.42.42.5(pid=24991) [trial-2361↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24991)] [trial-2361↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 16:55:51.149799 tst handover.py:18: Test FAILED (6.7 sec) 16:55:51.177388 run osmo-hlr_10.42.42.2(pid=24988): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24988)] 16:55:51.227715 run osmo-hlr_10.42.42.2(pid=24988): stdout: | (launched: 2022-12-09_16:55:48.213948) 16:55:51.279261 run osmo-hlr_10.42.42.2(pid=24988): stderr: | [0;m[1;31m20221209165548414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165548415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165548415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165548415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165548415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165548415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165548427 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165548436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165548436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165548436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:55:51.351181 run osmo-msc_10.42.42.6(pid=24994): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24994)] 16:55:51.401124 run osmo-msc_10.42.42.6(pid=24994): stdout: | (launched: 2022-12-09_16:55:50.202956) 16:55:51.452531 run osmo-msc_10.42.42.6(pid=24994): stderr: | [0;m[38;5;43m20221209165550524 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165550524 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd372a66c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165550524 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165550524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165550524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165550525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165550528 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165550528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165550529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165550529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:55:51.504391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24987): Terminating (SIGTERM) 16:55:51.546379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24990): Terminating (SIGTERM) 16:55:51.588095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24993): Terminating (SIGTERM) 16:55:51.630040 --- ParallelTerminationStrategy: PID 24987 died... 16:55:51.649942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24987): Terminated: ok {rc=0} 16:55:51.696579 --- ParallelTerminationStrategy: PID 24990 died... 16:55:51.716044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24990): Terminated: ok {rc=0} 16:55:51.762623 --- ParallelTerminationStrategy: PID 24993 died... 16:55:51.782146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24993): Terminated: ok {rc=0} 16:55:51.870128 bus /sierra_3: Setting Powered False 16:55:52.967735 bus /sierra_3: Setting Powered False 16:55:54.085618 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 16:55:55.341759 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:55:55.346630 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 16:55:55.383879 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 16:55:55.410496 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 16:55:55.464183 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 16:55:55.503469 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 16:55:55.532366 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 16:55:56.078519 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 16:55:56.084271 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:55:56.095740 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 16:55:56.133165 tst handover.py: using LAC 22430 16:55:56.260356 tst handover.py: using RAC 245 16:55:56.389711 tst handover.py: using CellId 22430 16:55:56.514732 tst handover.py: using BVCI 22431 16:55:56.625975 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 16:55:56.658535 tst handover.py: using LAC 22431 16:55:56.776292 tst handover.py: using RAC 246 16:55:56.894973 tst handover.py: using CellId 22431 16:55:57.012605 tst handover.py: using BVCI 22432 16:55:57.122710 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:55:57.133713 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:55:57.144213 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:55:57.155364 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:55:57.166569 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 16:55:57.177758 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 16:55:57.299332 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 16:55:57.419457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:57.865727 run create_hlr_db(pid=25000): Launched 16:55:57.989925 bus /sierra_2: Setting Powered False 16:55:59.051578 run create_hlr_db(pid=25000): Terminated: ok {rc=0} 16:55:59.468509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25002): Launched 16:55:59.796072 run osmo-hlr_10.42.42.2(pid=25003): Launched 16:55:59.920434 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:00.454783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25005): Launched 16:56:00.780178 run osmo-stp_10.42.42.5(pid=25006): Launched 16:56:00.984630 run osmo-msc_10.42.42.6: Starting osmo-msc 16:56:01.598374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25008): Launched 16:56:01.926461 run osmo-msc_10.42.42.6(pid=25009): Launched 16:56:02.185585 run osmo-stp_10.42.42.5(pid=25006): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25006)] 16:56:02.420864 run osmo-stp_10.42.42.5(pid=25006): stdout: | (launched: 2022-12-09_16:56:00.720801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:02.551345 run osmo-stp_10.42.42.5(pid=25006): stderr: | [0;m[38;5;43m20221209165600989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165600989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165600989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165600990 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165600990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165600990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165600990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:02.688412 run osmo-stp_10.42.42.5(pid=25006): stdout: | (launched: 2022-12-09_16:56:00.720801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:02.818807 run osmo-stp_10.42.42.5(pid=25006): stderr: | [0;m[38;5;43m20221209165600989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165600989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165600989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165600990 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165600990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165600990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165600990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:02.974663 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25006): Process ended prematurely: osmo-stp_10.42.42.5(pid=25006) [trial-2361↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25006)] [trial-2361↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 16:56:02.983638 tst handover.py:18: Test FAILED (6.9 sec) 16:56:03.011865 run osmo-hlr_10.42.42.2(pid=25003): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25003)] 16:56:03.061821 run osmo-hlr_10.42.42.2(pid=25003): stdout: | (launched: 2022-12-09_16:55:59.736439) 16:56:03.113741 run osmo-hlr_10.42.42.2(pid=25003): stderr: | [0;m[1;31m20221209165559937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165559937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165559937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165559937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165559937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165559937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165559949 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165559958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165559958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165559958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:03.186003 run osmo-msc_10.42.42.6(pid=25009): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25009)] 16:56:03.236169 run osmo-msc_10.42.42.6(pid=25009): stdout: | (launched: 2022-12-09_16:56:01.863479) 16:56:03.287698 run osmo-msc_10.42.42.6(pid=25009): stderr: | [0;m[38;5;43m20221209165602341 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165602341 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4bec36bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165602341 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165602341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165602342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165602342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165602343 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165602344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165602344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165602344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:56:03.339969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25002): Terminating (SIGTERM) 16:56:03.382113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25005): Terminating (SIGTERM) 16:56:03.424197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25008): Terminating (SIGTERM) 16:56:03.466458 --- ParallelTerminationStrategy: PID 25002 died... 16:56:03.486412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25002): Terminated: ok {rc=0} 16:56:03.533534 --- ParallelTerminationStrategy: PID 25005 died... 16:56:03.552807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25005): Terminated: ok {rc=0} 16:56:03.599394 --- ParallelTerminationStrategy: PID 25008 died... 16:56:03.618831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25008): Terminated: ok {rc=0} 16:56:03.706873 bus /sierra_3: Setting Powered False 16:56:04.805423 bus /sierra_3: Setting Powered False 16:56:05.921386 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 16:56:07.161140 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:56:07.166166 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 16:56:07.215839 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 16:56:07.242306 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 16:56:07.294743 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 16:56:07.344240 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 16:56:07.370417 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 16:56:07.921239 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 16:56:07.926327 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:56:07.937440 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:56:07.971664 tst handover.py: using LAC 22432 16:56:08.106671 tst handover.py: using RAC 247 16:56:08.233414 tst handover.py: using CellId 22432 16:56:08.359398 tst handover.py: using BVCI 22433 16:56:08.477938 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:56:08.526134 tst handover.py: using LAC 22433 16:56:08.657778 tst handover.py: using RAC 248 16:56:08.777448 tst handover.py: using CellId 22433 16:56:08.895608 tst handover.py: using BVCI 22434 16:56:09.006361 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:56:09.017350 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:56:09.028066 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:56:09.039476 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:56:09.050955 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:56:09.062320 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:56:09.183664 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:56:09.303925 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:09.781224 run create_hlr_db(pid=25015): Launched 16:56:09.906110 bus /sierra_2: Setting Powered False 16:56:10.970531 run create_hlr_db(pid=25015): Terminated: ok {rc=0} 16:56:11.394956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25017): Launched 16:56:11.722691 run osmo-hlr_10.42.42.2(pid=25018): Launched 16:56:11.847549 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:12.380752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25020): Launched 16:56:12.685914 run osmo-stp_10.42.42.5(pid=25021): Launched 16:56:12.801380 run osmo-msc_10.42.42.6: Starting osmo-msc 16:56:13.324817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25023): Launched 16:56:13.629643 run osmo-msc_10.42.42.6(pid=25024): Launched 16:56:13.799515 run osmo-stp_10.42.42.5(pid=25021): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25021)] 16:56:13.927754 run osmo-stp_10.42.42.5(pid=25021): stdout: | (launched: 2022-12-09_16:56:12.629736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:14.055233 run osmo-stp_10.42.42.5(pid=25021): stderr: | [0;m[38;5;43m20221209165612800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165612800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165612800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165612801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165612801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165612801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165612801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:14.180808 run osmo-stp_10.42.42.5(pid=25021): stdout: | (launched: 2022-12-09_16:56:12.629736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:14.301187 run osmo-stp_10.42.42.5(pid=25021): stderr: | [0;m[38;5;43m20221209165612800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165612800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165612800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165612801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165612801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165612801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165612801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:14.445330 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25021): Process ended prematurely: osmo-stp_10.42.42.5(pid=25021) [trial-2361↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25021)] [trial-2361↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 16:56:14.453404 tst handover.py:18: Test FAILED (6.5 sec) 16:56:14.479036 run osmo-hlr_10.42.42.2(pid=25018): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25018)] 16:56:14.525674 run osmo-hlr_10.42.42.2(pid=25018): stdout: | (launched: 2022-12-09_16:56:11.663450) 16:56:14.574117 run osmo-hlr_10.42.42.2(pid=25018): stderr: | [0;m[1;31m20221209165611863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165611863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165611863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165611863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165611863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165611863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165611875 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165611883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165611884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165611884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:14.642018 run osmo-msc_10.42.42.6(pid=25024): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25024)] 16:56:14.688676 run osmo-msc_10.42.42.6(pid=25024): stdout: | (launched: 2022-12-09_16:56:13.573991) 16:56:14.737076 run osmo-msc_10.42.42.6(pid=25024): stderr: | [0;m[38;5;43m20221209165613845 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165613845 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3fd4264c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165613845 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165613845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165613845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165613846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165613848 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165613849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165613849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165613849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:56:14.785702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25017): Terminating (SIGTERM) 16:56:14.824297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25020): Terminating (SIGTERM) 16:56:14.863026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25023): Terminating (SIGTERM) 16:56:14.902223 --- ParallelTerminationStrategy: PID 25017 died... 16:56:14.920780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25017): Terminated: ok {rc=0} 16:56:14.963826 --- ParallelTerminationStrategy: PID 25020 died... 16:56:14.981919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25020): Terminated: ok {rc=0} 16:56:15.025373 --- ParallelTerminationStrategy: PID 25023 died... 16:56:15.043573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25023): Terminated: ok {rc=0} 16:56:15.127682 bus /sierra_3: Setting Powered False 16:56:16.232165 bus /sierra_3: Setting Powered False 16:56:17.358954 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 16:56:18.611259 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:56:18.617942 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 16:56:18.666256 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:56:18.694070 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:56:18.747332 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 16:56:18.794754 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:56:18.822244 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:56:19.376090 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 16:56:19.382029 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:56:19.393618 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:56:19.429350 tst handover.py: using LAC 22434 16:56:19.556940 tst handover.py: using RAC 249 16:56:19.686040 tst handover.py: using CellId 22434 16:56:19.813349 tst handover.py: using BVCI 22435 16:56:19.931282 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:56:19.977064 tst handover.py: using LAC 22435 16:56:20.105364 tst handover.py: using RAC 250 16:56:20.234196 tst handover.py: using CellId 22435 16:56:20.362266 tst handover.py: using BVCI 22436 16:56:20.480545 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:56:20.492227 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:56:20.503737 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:56:20.515380 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:56:20.527077 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:56:20.539160 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:56:20.661555 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:56:20.779134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:21.225360 run create_hlr_db(pid=25029): Launched 16:56:21.350470 bus /sierra_2: Setting Powered False 16:56:22.411102 run create_hlr_db(pid=25029): Terminated: ok {rc=0} 16:56:22.809111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25031): Launched 16:56:23.114275 run osmo-hlr_10.42.42.2(pid=25032): Launched 16:56:23.229556 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:23.726087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25034): Launched 16:56:24.030634 run osmo-stp_10.42.42.5(pid=25035): Launched 16:56:24.146486 run osmo-msc_10.42.42.6: Starting osmo-msc 16:56:24.670410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25037): Launched 16:56:24.975888 run osmo-msc_10.42.42.6(pid=25038): Launched 16:56:25.147009 run osmo-stp_10.42.42.5(pid=25035): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25035)] 16:56:25.275537 run osmo-stp_10.42.42.5(pid=25035): stdout: | (launched: 2022-12-09_16:56:23.974708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:25.403710 run osmo-stp_10.42.42.5(pid=25035): stderr: | [0;m[38;5;43m20221209165624145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165624145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165624146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165624146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165624146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165624146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165624147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:25.529852 run osmo-stp_10.42.42.5(pid=25035): stdout: | (launched: 2022-12-09_16:56:23.974708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:25.651097 run osmo-stp_10.42.42.5(pid=25035): stderr: | [0;m[38;5;43m20221209165624145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165624145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165624146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165624146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165624146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165624146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165624147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:25.795587 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25035): Process ended prematurely: osmo-stp_10.42.42.5(pid=25035) [trial-2361↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25035)] [trial-2361↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 16:56:25.803746 tst handover.py:18: Test FAILED (6.4 sec) 16:56:25.829451 run osmo-hlr_10.42.42.2(pid=25032): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25032)] 16:56:25.876402 run osmo-hlr_10.42.42.2(pid=25032): stdout: | (launched: 2022-12-09_16:56:23.057758) 16:56:25.925183 run osmo-hlr_10.42.42.2(pid=25032): stderr: | [0;m[1;31m20221209165623237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165623237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165623237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165623237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165623237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165623237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165623249 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165623259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165623259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165623259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:25.992740 run osmo-msc_10.42.42.6(pid=25038): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25038)] 16:56:26.039665 run osmo-msc_10.42.42.6(pid=25038): stdout: | (launched: 2022-12-09_16:56:24.919290) 16:56:26.088339 run osmo-msc_10.42.42.6(pid=25038): stderr: | [0;m[38;5;43m20221209165625192 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165625192 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f97a2722c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165625192 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165625192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165625193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165625193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165625195 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165625195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165625195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165625195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:56:26.137412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25031): Terminating (SIGTERM) 16:56:26.176607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25034): Terminating (SIGTERM) 16:56:26.215729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25037): Terminating (SIGTERM) 16:56:26.255148 --- ParallelTerminationStrategy: PID 25031 died... 16:56:26.273990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25031): Terminated: ok {rc=0} 16:56:26.317357 --- ParallelTerminationStrategy: PID 25034 died... 16:56:26.335675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25034): Terminated: ok {rc=0} 16:56:26.379136 --- ParallelTerminationStrategy: PID 25037 died... 16:56:26.397512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25037): Terminated: ok {rc=0} 16:56:26.482833 bus /sierra_3: Setting Powered False 16:56:27.581587 bus /sierra_3: Setting Powered False 16:56:28.693471 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 16:56:29.949565 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:56:29.955574 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 16:56:30.009230 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:56:30.036837 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:56:30.090740 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 16:56:30.143936 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:56:30.171125 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:56:30.722450 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 16:56:30.727895 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:56:30.739390 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:56:30.775076 tst handover.py: using LAC 22436 16:56:30.919915 tst handover.py: using RAC 251 16:56:31.055514 tst handover.py: using CellId 22436 16:56:31.222263 tst handover.py: using BVCI 22437 16:56:31.380263 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:56:31.441817 tst handover.py: using LAC 22437 16:56:31.607135 tst handover.py: using RAC 252 16:56:31.739081 tst handover.py: using CellId 22437 16:56:31.912114 tst handover.py: using BVCI 22438 16:56:32.034453 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:56:32.046821 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:56:32.059023 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:56:32.071896 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:56:32.085660 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:56:32.097838 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:56:32.242382 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:56:32.366069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:32.843990 run create_hlr_db(pid=25043): Launched 16:56:32.969281 bus /sierra_2: Setting Powered False 16:56:34.033766 run create_hlr_db(pid=25043): Terminated: ok {rc=0} 16:56:34.458642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25045): Launched 16:56:34.786306 run osmo-hlr_10.42.42.2(pid=25046): Launched 16:56:34.911189 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:35.446218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25048): Launched 16:56:35.772071 run osmo-stp_10.42.42.5(pid=25049): Launched 16:56:35.897555 run osmo-msc_10.42.42.6: Starting osmo-msc 16:56:36.457661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25051): Launched 16:56:36.785831 run osmo-msc_10.42.42.6(pid=25052): Launched 16:56:36.967757 run osmo-stp_10.42.42.5(pid=25049): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25049)] 16:56:37.109377 run osmo-stp_10.42.42.5(pid=25049): stdout: | (launched: 2022-12-09_16:56:35.713127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:37.245292 run osmo-stp_10.42.42.5(pid=25049): stderr: | [0;m[38;5;43m20221209165635907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165635907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165635907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165635908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165635908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165635908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165635908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:37.380782 run osmo-stp_10.42.42.5(pid=25049): stdout: | (launched: 2022-12-09_16:56:35.713127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:37.510916 run osmo-stp_10.42.42.5(pid=25049): stderr: | [0;m[38;5;43m20221209165635907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165635907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165635907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165635908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165635908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165635908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165635908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:37.666967 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25049): Process ended prematurely: osmo-stp_10.42.42.5(pid=25049) [trial-2361↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25049)] [trial-2361↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 16:56:37.675583 tst handover.py:18: Test FAILED (6.9 sec) 16:56:37.703246 run osmo-hlr_10.42.42.2(pid=25046): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25046)] 16:56:37.753331 run osmo-hlr_10.42.42.2(pid=25046): stdout: | (launched: 2022-12-09_16:56:34.726959) 16:56:37.804603 run osmo-hlr_10.42.42.2(pid=25046): stderr: | [0;m[1;31m20221209165634926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165634926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165634926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165634926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165634926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165634926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165634939 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165634949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165634949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165634949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:37.876020 run osmo-msc_10.42.42.6(pid=25052): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25052)] 16:56:37.925859 run osmo-msc_10.42.42.6(pid=25052): stdout: | (launched: 2022-12-09_16:56:36.726329) 16:56:37.977258 run osmo-msc_10.42.42.6(pid=25052): stderr: | [0;m[38;5;43m20221209165637047 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165637047 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff88a037c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165637047 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165637047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165637047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165637047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165637049 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165637049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165637050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165637050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:56:38.028853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25045): Terminating (SIGTERM) 16:56:38.070575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25048): Terminating (SIGTERM) 16:56:38.112104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25051): Terminating (SIGTERM) 16:56:38.153910 --- ParallelTerminationStrategy: PID 25045 died... 16:56:38.173509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25045): Terminated: ok {rc=0} 16:56:38.219610 --- ParallelTerminationStrategy: PID 25048 died... 16:56:38.238926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25048): Terminated: ok {rc=0} 16:56:38.284716 --- ParallelTerminationStrategy: PID 25051 died... 16:56:38.303982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25051): Terminated: ok {rc=0} 16:56:38.390790 bus /sierra_3: Setting Powered False 16:56:39.488268 bus /sierra_3: Setting Powered False 16:56:40.602697 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 16:56:41.862070 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:56:41.867362 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 16:56:41.907499 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 16:56:41.934998 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 16:56:41.987382 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 16:56:42.026543 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 16:56:42.053979 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 16:56:42.606205 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 16:56:42.611941 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:56:42.623588 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 16:56:42.659362 tst handover.py: using LAC 22438 16:56:42.787868 tst handover.py: using RAC 253 16:56:42.908908 tst handover.py: using CellId 22438 16:56:43.032728 tst handover.py: using BVCI 22439 16:56:43.144629 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 16:56:43.178178 tst handover.py: using LAC 22439 16:56:43.296927 tst handover.py: using RAC 254 16:56:43.414461 tst handover.py: using CellId 22439 16:56:43.535746 tst handover.py: using BVCI 22440 16:56:43.647380 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:56:43.658148 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:56:43.668696 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:56:43.679365 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:56:43.689940 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:56:43.700403 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 16:56:43.819240 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 16:56:43.941767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:44.418058 run create_hlr_db(pid=25057): Launched 16:56:44.545534 bus /sierra_2: Setting Powered False 16:56:45.609937 run create_hlr_db(pid=25057): Terminated: ok {rc=0} 16:56:46.053736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25059): Launched 16:56:46.394871 run osmo-hlr_10.42.42.2(pid=25060): Launched 16:56:46.634798 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:47.255655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25062): Launched 16:56:47.581408 run osmo-stp_10.42.42.5(pid=25063): Launched 16:56:47.705773 run osmo-msc_10.42.42.6: Starting osmo-msc 16:56:48.266607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25065): Launched 16:56:48.593328 run osmo-msc_10.42.42.6(pid=25066): Launched 16:56:48.775263 run osmo-stp_10.42.42.5(pid=25063): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25063)] 16:56:48.912710 run osmo-stp_10.42.42.5(pid=25063): stdout: | (launched: 2022-12-09_16:56:47.521267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:49.050473 run osmo-stp_10.42.42.5(pid=25063): stderr: | [0;m[38;5;43m20221209165647712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165647713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165647713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165647713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165647714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165647714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165647714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:49.187364 run osmo-stp_10.42.42.5(pid=25063): stdout: | (launched: 2022-12-09_16:56:47.521267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:49.317504 run osmo-stp_10.42.42.5(pid=25063): stderr: | [0;m[38;5;43m20221209165647712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165647713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165647713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165647713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165647714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165647714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165647714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:49.472475 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25063): Process ended prematurely: osmo-stp_10.42.42.5(pid=25063) [trial-2361↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25063)] [trial-2361↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 16:56:49.481500 tst handover.py:18: Test FAILED (6.9 sec) 16:56:49.508731 run osmo-hlr_10.42.42.2(pid=25060): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25060)] 16:56:49.559113 run osmo-hlr_10.42.42.2(pid=25060): stdout: | (launched: 2022-12-09_16:56:46.330201) 16:56:49.610751 run osmo-hlr_10.42.42.2(pid=25060): stderr: | [0;m[1;31m20221209165646620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165646620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165646620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165646621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165646621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165646621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165646654 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165646662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165646663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165646663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:49.682235 run osmo-msc_10.42.42.6(pid=25066): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25066)] 16:56:49.731911 run osmo-msc_10.42.42.6(pid=25066): stdout: | (launched: 2022-12-09_16:56:48.533059) 16:56:49.783288 run osmo-msc_10.42.42.6(pid=25066): stderr: | [0;m[38;5;43m20221209165648857 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165648858 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4fee3c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165648858 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165648858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165648858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165648858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165648860 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165648860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165648860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165648860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:56:49.835000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25059): Terminating (SIGTERM) 16:56:49.876744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25062): Terminating (SIGTERM) 16:56:49.918694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25065): Terminating (SIGTERM) 16:56:49.960705 --- ParallelTerminationStrategy: PID 25059 died... 16:56:49.980520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25059): Terminated: ok {rc=0} 16:56:50.026819 --- ParallelTerminationStrategy: PID 25062 died... 16:56:50.046344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25062): Terminated: ok {rc=0} 16:56:50.092431 --- ParallelTerminationStrategy: PID 25065 died... 16:56:50.111883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25065): Terminated: ok {rc=0} 16:56:50.199572 bus /sierra_3: Setting Powered False 16:56:51.298491 bus /sierra_3: Setting Powered False 16:56:52.413330 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 16:56:53.653747 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:56:53.659358 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 16:56:53.711415 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 16:56:53.739216 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 16:56:53.793099 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 16:56:53.842462 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 16:56:53.868515 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 16:56:54.423012 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 16:56:54.428278 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:56:54.439046 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:56:54.472812 tst handover.py: using LAC 22440 16:56:54.592084 tst handover.py: using RAC 255 16:56:54.712098 tst handover.py: using CellId 22440 16:56:54.834506 tst handover.py: using BVCI 22441 16:56:54.955478 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:56:55.005141 tst handover.py: using LAC 22441 16:56:55.134370 tst handover.py: using RAC 1 16:56:55.263235 tst handover.py: using CellId 22441 16:56:55.392810 tst handover.py: using BVCI 22442 16:56:55.512817 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:56:55.524410 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:56:55.535504 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:56:55.547358 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:56:55.559607 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:56:55.571409 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:56:55.689748 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:56:55.806418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:56.248838 run create_hlr_db(pid=25071): Launched 16:56:56.373742 bus /sierra_2: Setting Powered False 16:56:57.434768 run create_hlr_db(pid=25071): Terminated: ok {rc=0} 16:56:57.852730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25073): Launched 16:56:58.179376 run osmo-hlr_10.42.42.2(pid=25074): Launched 16:56:58.303921 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:58.839782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25076): Launched 16:56:59.165974 run osmo-stp_10.42.42.5(pid=25077): Launched 16:56:59.290563 run osmo-msc_10.42.42.6: Starting osmo-msc 16:56:59.852351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25079): Launched 16:57:00.179369 run osmo-msc_10.42.42.6(pid=25080): Launched 16:57:00.361940 run osmo-stp_10.42.42.5(pid=25077): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25077)] 16:57:00.500232 run osmo-stp_10.42.42.5(pid=25077): stdout: | (launched: 2022-12-09_16:56:59.106364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:00.639808 run osmo-stp_10.42.42.5(pid=25077): stderr: | [0;m[38;5;43m20221209165659298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165659298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165659299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165659299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165659299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165659299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165659300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:00.777286 run osmo-stp_10.42.42.5(pid=25077): stdout: | (launched: 2022-12-09_16:56:59.106364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:00.923195 run osmo-stp_10.42.42.5(pid=25077): stderr: | [0;m[38;5;43m20221209165659298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165659298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165659299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165659299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165659299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165659299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165659300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:01.082687 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25077): Process ended prematurely: osmo-stp_10.42.42.5(pid=25077) [trial-2361↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25077)] [trial-2361↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 16:57:01.092505 tst handover.py:18: Test FAILED (6.7 sec) 16:57:01.123470 run osmo-hlr_10.42.42.2(pid=25074): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25074)] 16:57:01.175788 run osmo-hlr_10.42.42.2(pid=25074): stdout: | (launched: 2022-12-09_16:56:58.119509) 16:57:01.229841 run osmo-hlr_10.42.42.2(pid=25074): stderr: | [0;m[1;31m20221209165658316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165658316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165658317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165658317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165658317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165658317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165658329 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165658337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165658337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165658338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:01.305000 run osmo-msc_10.42.42.6(pid=25080): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25080)] 16:57:01.357528 run osmo-msc_10.42.42.6(pid=25080): stdout: | (launched: 2022-12-09_16:57:00.119380) 16:57:01.411722 run osmo-msc_10.42.42.6(pid=25080): stderr: | [0;m[38;5;43m20221209165700442 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165700443 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f894d7c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165700443 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165700443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165700443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165700443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165700445 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165700445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165700445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165700445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:01.466071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25073): Terminating (SIGTERM) 16:57:01.510235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25076): Terminating (SIGTERM) 16:57:01.555589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25079): Terminating (SIGTERM) 16:57:01.600570 --- ParallelTerminationStrategy: PID 25073 died... 16:57:01.621437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25073): Terminated: ok {rc=0} 16:57:01.671807 --- ParallelTerminationStrategy: PID 25076 died... 16:57:01.692224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25076): Terminated: ok {rc=0} 16:57:01.741516 --- ParallelTerminationStrategy: PID 25079 died... 16:57:01.761914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25079): Terminated: ok {rc=0} 16:57:01.853921 bus /sierra_3: Setting Powered False 16:57:02.949222 bus /sierra_3: Setting Powered False 16:57:04.061381 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 16:57:05.317904 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:05.323653 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 16:57:05.375286 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:57:05.403131 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 16:57:05.456765 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 16:57:05.505616 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:57:05.531750 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 16:57:06.086093 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 16:57:06.091792 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:57:06.103156 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:57:06.137895 tst handover.py: using LAC 22442 16:57:06.267585 tst handover.py: using RAC 2 16:57:06.393830 tst handover.py: using CellId 22442 16:57:06.512678 tst handover.py: using BVCI 22443 16:57:06.622564 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:57:06.669966 tst handover.py: using LAC 22443 16:57:06.790151 tst handover.py: using RAC 3 16:57:06.911147 tst handover.py: using CellId 22443 16:57:07.031258 tst handover.py: using BVCI 22444 16:57:07.141655 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:57:07.152469 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:57:07.163109 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:57:07.173824 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:57:07.184451 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:57:07.194998 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:57:07.309497 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:57:07.427254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:07.906099 run create_hlr_db(pid=25085): Launched 16:57:08.032112 bus /sierra_2: Setting Powered False 16:57:09.097176 run create_hlr_db(pid=25085): Terminated: ok {rc=0} 16:57:09.522979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25087): Launched 16:57:09.852711 run osmo-hlr_10.42.42.2(pid=25088): Launched 16:57:09.978225 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:10.511384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25090): Launched 16:57:10.839093 run osmo-stp_10.42.42.5(pid=25091): Launched 16:57:10.963719 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:11.525579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25093): Launched 16:57:11.853938 run osmo-msc_10.42.42.6(pid=25094): Launched 16:57:12.035677 run osmo-stp_10.42.42.5(pid=25091): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25091)] 16:57:12.173501 run osmo-stp_10.42.42.5(pid=25091): stdout: | (launched: 2022-12-09_16:57:10.779698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:12.311623 run osmo-stp_10.42.42.5(pid=25091): stderr: | [0;m[38;5;43m20221209165710970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165710970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165710970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165710970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165710973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165710973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165710973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:12.448848 run osmo-stp_10.42.42.5(pid=25091): stdout: | (launched: 2022-12-09_16:57:10.779698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:12.580153 run osmo-stp_10.42.42.5(pid=25091): stderr: | [0;m[38;5;43m20221209165710970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165710970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165710970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165710970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165710973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165710973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165710973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:12.736554 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25091): Process ended prematurely: osmo-stp_10.42.42.5(pid=25091) [trial-2361↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25091)] [trial-2361↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 16:57:12.745637 tst handover.py:18: Test FAILED (6.6 sec) 16:57:12.773479 run osmo-hlr_10.42.42.2(pid=25088): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25088)] 16:57:12.823309 run osmo-hlr_10.42.42.2(pid=25088): stdout: | (launched: 2022-12-09_16:57:09.793127) 16:57:12.874788 run osmo-hlr_10.42.42.2(pid=25088): stderr: | [0;m[1;31m20221209165709993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165709993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165709993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165709993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165709993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165709993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165710006 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165710014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165710014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165710014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:12.946262 run osmo-msc_10.42.42.6(pid=25094): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25094)] 16:57:12.995767 run osmo-msc_10.42.42.6(pid=25094): stdout: | (launched: 2022-12-09_16:57:11.794224) 16:57:13.046909 run osmo-msc_10.42.42.6(pid=25094): stderr: | [0;m[38;5;43m20221209165712115 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165712115 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fac45cc1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165712115 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165712115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165712115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165712115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165712117 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165712118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165712118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165712118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:13.098649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25087): Terminating (SIGTERM) 16:57:13.139855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25090): Terminating (SIGTERM) 16:57:13.181789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25093): Terminating (SIGTERM) 16:57:13.223537 --- ParallelTerminationStrategy: PID 25087 died... 16:57:13.243265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25087): Terminated: ok {rc=0} 16:57:13.289215 --- ParallelTerminationStrategy: PID 25090 died... 16:57:13.308471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25090): Terminated: ok {rc=0} 16:57:13.354531 --- ParallelTerminationStrategy: PID 25093 died... 16:57:13.373932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25093): Terminated: ok {rc=0} 16:57:13.462420 bus /sierra_3: Setting Powered False 16:57:14.559774 bus /sierra_3: Setting Powered False 16:57:15.675924 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 16:57:16.927772 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:16.932705 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 16:57:16.982055 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 16:57:17.009381 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 16:57:17.062704 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 16:57:17.128848 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 16:57:17.172440 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 16:57:17.689853 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 16:57:17.695362 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:57:17.706839 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:57:17.741816 tst handover.py: using LAC 22444 16:57:17.868811 tst handover.py: using RAC 4 16:57:17.995906 tst handover.py: using CellId 22444 16:57:18.122718 tst handover.py: using BVCI 22445 16:57:18.240702 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 16:57:18.289790 tst handover.py: using LAC 22445 16:57:18.419061 tst handover.py: using RAC 5 16:57:18.547457 tst handover.py: using CellId 22445 16:57:18.668722 tst handover.py: using BVCI 22446 16:57:18.778885 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:57:18.789930 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:57:18.800720 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:57:18.811712 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:57:18.822918 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 16:57:18.833833 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:57:18.948561 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 16:57:19.067036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:19.543035 run create_hlr_db(pid=25099): Launched 16:57:19.668769 bus /sierra_2: Setting Powered False 16:57:20.730562 run create_hlr_db(pid=25099): Terminated: ok {rc=0} 16:57:21.130584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25101): Launched 16:57:21.434835 run osmo-hlr_10.42.42.2(pid=25102): Launched 16:57:21.551417 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:22.063174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25104): Launched 16:57:22.366112 run osmo-stp_10.42.42.5(pid=25105): Launched 16:57:22.481789 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:23.009556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25107): Launched 16:57:23.314252 run osmo-msc_10.42.42.6(pid=25108): Launched 16:57:23.483803 run osmo-stp_10.42.42.5(pid=25105): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25105)] 16:57:23.613675 run osmo-stp_10.42.42.5(pid=25105): stdout: | (launched: 2022-12-09_16:57:22.310657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:23.742129 run osmo-stp_10.42.42.5(pid=25105): stderr: | [0;m[38;5;43m20221209165722482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165722482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165722482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165722483 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165722483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165722483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165722483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:23.868602 run osmo-stp_10.42.42.5(pid=25105): stdout: | (launched: 2022-12-09_16:57:22.310657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:23.990148 run osmo-stp_10.42.42.5(pid=25105): stderr: | [0;m[38;5;43m20221209165722482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165722482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165722482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165722483 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165722483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165722483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165722483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:24.135348 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25105): Process ended prematurely: osmo-stp_10.42.42.5(pid=25105) [trial-2361↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25105)] [trial-2361↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 16:57:24.143712 tst handover.py:18: Test FAILED (6.4 sec) 16:57:24.169607 run osmo-hlr_10.42.42.2(pid=25102): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25102)] 16:57:24.216697 run osmo-hlr_10.42.42.2(pid=25102): stdout: | (launched: 2022-12-09_16:57:21.379059) 16:57:24.265787 run osmo-hlr_10.42.42.2(pid=25102): stderr: | [0;m[1;31m20221209165721554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165721554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165721554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165721554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165721554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165721554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165721567 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165721576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165721576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165721576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:24.334186 run osmo-msc_10.42.42.6(pid=25108): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25108)] 16:57:24.381444 run osmo-msc_10.42.42.6(pid=25108): stdout: | (launched: 2022-12-09_16:57:23.258315) 16:57:24.430242 run osmo-msc_10.42.42.6(pid=25108): stderr: | [0;m[38;5;43m20221209165723529 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165723530 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f112a386c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165723530 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165723530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165723530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165723530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165723532 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165723532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165723532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165723533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:24.479422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25101): Terminating (SIGTERM) 16:57:24.518780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25104): Terminating (SIGTERM) 16:57:24.558319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25107): Terminating (SIGTERM) 16:57:24.598433 --- ParallelTerminationStrategy: PID 25101 died... 16:57:24.617443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25101): Terminated: ok {rc=0} 16:57:24.660910 --- ParallelTerminationStrategy: PID 25104 died... 16:57:24.679430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25104): Terminated: ok {rc=0} 16:57:24.722988 --- ParallelTerminationStrategy: PID 25107 died... 16:57:24.741760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25107): Terminated: ok {rc=0} 16:57:24.827782 bus /sierra_3: Setting Powered False 16:57:25.927993 bus /sierra_3: Setting Powered False 16:57:27.043549 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 16:57:28.296517 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:28.301752 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 16:57:28.346559 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:57:28.373428 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:57:28.426283 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 16:57:28.471182 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:57:28.497440 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:57:29.049611 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 16:57:29.055059 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:29.066375 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:57:29.100858 tst handover.py: using LAC 22446 16:57:29.223363 tst handover.py: using RAC 6 16:57:29.342369 tst handover.py: using CellId 22446 16:57:29.465217 tst handover.py: using BVCI 22447 16:57:29.575935 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:57:29.619617 tst handover.py: using LAC 22447 16:57:29.737121 tst handover.py: using RAC 7 16:57:29.856571 tst handover.py: using CellId 22447 16:57:29.974784 tst handover.py: using BVCI 22448 16:57:30.085524 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:30.096585 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:30.107446 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:30.118328 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:30.129480 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:57:30.140372 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:57:30.262635 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:57:30.382230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:30.868319 run create_hlr_db(pid=25113): Launched 16:57:31.029735 bus /sierra_2: Setting Powered False 16:57:32.112091 run create_hlr_db(pid=25113): Terminated: ok {rc=0} 16:57:32.551011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25115): Launched 16:57:32.857678 run osmo-hlr_10.42.42.2(pid=25116): Launched 16:57:32.974831 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:33.471469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25118): Launched 16:57:33.776035 run osmo-stp_10.42.42.5(pid=25119): Launched 16:57:33.892567 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:34.416501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25121): Launched 16:57:34.721456 run osmo-msc_10.42.42.6(pid=25122): Launched 16:57:34.892098 run osmo-stp_10.42.42.5(pid=25119): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25119)] 16:57:35.020386 run osmo-stp_10.42.42.5(pid=25119): stdout: | (launched: 2022-12-09_16:57:33.720433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:35.148741 run osmo-stp_10.42.42.5(pid=25119): stderr: | [0;m[38;5;43m20221209165733889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165733889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165733889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165733890 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165733892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165733892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165733892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:35.274941 run osmo-stp_10.42.42.5(pid=25119): stdout: | (launched: 2022-12-09_16:57:33.720433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:35.395772 run osmo-stp_10.42.42.5(pid=25119): stderr: | [0;m[38;5;43m20221209165733889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165733889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165733889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165733890 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165733892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165733892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165733892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:35.540199 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25119): Process ended prematurely: osmo-stp_10.42.42.5(pid=25119) [trial-2361↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25119)] [trial-2361↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 16:57:35.548304 tst handover.py:18: Test FAILED (6.5 sec) 16:57:35.574347 run osmo-hlr_10.42.42.2(pid=25116): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25116)] 16:57:35.621797 run osmo-hlr_10.42.42.2(pid=25116): stdout: | (launched: 2022-12-09_16:57:32.801462) 16:57:35.671446 run osmo-hlr_10.42.42.2(pid=25116): stderr: | [0;m[1;31m20221209165732976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165732976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165732976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165732976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165732976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165732976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165732990 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165732999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165732999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165732999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:35.739660 run osmo-msc_10.42.42.6(pid=25122): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25122)] 16:57:35.787223 run osmo-msc_10.42.42.6(pid=25122): stdout: | (launched: 2022-12-09_16:57:34.665694) 16:57:35.836354 run osmo-msc_10.42.42.6(pid=25122): stderr: | [0;m[38;5;43m20221209165734937 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165734937 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbddb109c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165734937 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165734937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165734937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165734938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165734939 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165734940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165734940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165734940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:35.885542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25115): Terminating (SIGTERM) 16:57:35.924431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25118): Terminating (SIGTERM) 16:57:35.963498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25121): Terminating (SIGTERM) 16:57:36.002833 --- ParallelTerminationStrategy: PID 25115 died... 16:57:36.021611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25115): Terminated: ok {rc=0} 16:57:36.064942 --- ParallelTerminationStrategy: PID 25118 died... 16:57:36.083361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25118): Terminated: ok {rc=0} 16:57:36.126484 --- ParallelTerminationStrategy: PID 25121 died... 16:57:36.144628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25121): Terminated: ok {rc=0} 16:57:36.226895 bus /sierra_3: Setting Powered False 16:57:37.324117 bus /sierra_3: Setting Powered False 16:57:38.439580 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 16:57:39.693288 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:39.698969 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 16:57:39.751029 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:57:39.778812 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:57:39.839487 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 16:57:39.888605 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:57:39.914949 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:57:40.463122 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 16:57:40.468908 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:40.480536 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:57:40.514924 tst handover.py: using LAC 22448 16:57:40.642906 tst handover.py: using RAC 8 16:57:40.770441 tst handover.py: using CellId 22448 16:57:40.897642 tst handover.py: using BVCI 22449 16:57:41.017791 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:57:41.066827 tst handover.py: using LAC 22449 16:57:41.197687 tst handover.py: using RAC 9 16:57:41.323001 tst handover.py: using CellId 22449 16:57:41.448629 tst handover.py: using BVCI 22450 16:57:41.566518 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:41.578181 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:41.590297 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:41.602229 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:41.613992 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:57:41.625842 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:57:41.743795 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:57:41.865728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:42.342546 run create_hlr_db(pid=25130): Launched 16:57:42.469251 bus /sierra_2: Setting Powered False 16:57:43.533725 run create_hlr_db(pid=25130): Terminated: ok {rc=0} 16:57:43.960748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25132): Launched 16:57:44.286987 run osmo-hlr_10.42.42.2(pid=25133): Launched 16:57:44.413834 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:44.949526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25135): Launched 16:57:45.275888 run osmo-stp_10.42.42.5(pid=25136): Launched 16:57:45.401064 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:46.012252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25138): Launched 16:57:46.361761 run osmo-msc_10.42.42.6(pid=25139): Launched 16:57:46.643229 run osmo-stp_10.42.42.5(pid=25136): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25136)] 16:57:46.927898 run osmo-stp_10.42.42.5(pid=25136): stdout: | (launched: 2022-12-09_16:57:45.216373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:47.231627 run osmo-stp_10.42.42.5(pid=25136): stderr: | [0;m[38;5;43m20221209165745410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165745410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165745410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165745410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165745411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165745411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165745411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:47.373478 run osmo-stp_10.42.42.5(pid=25136): stdout: | (launched: 2022-12-09_16:57:45.216373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:47.504865 run osmo-stp_10.42.42.5(pid=25136): stderr: | [0;m[38;5;43m20221209165745410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165745410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165745410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165745410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165745411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165745411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165745411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:47.661831 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25136): Process ended prematurely: osmo-stp_10.42.42.5(pid=25136) [trial-2361↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25136)] [trial-2361↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 16:57:47.670674 tst handover.py:18: Test FAILED (7.2 sec) 16:57:47.697840 run osmo-hlr_10.42.42.2(pid=25133): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25133)] 16:57:47.747389 run osmo-hlr_10.42.42.2(pid=25133): stdout: | (launched: 2022-12-09_16:57:44.227987) 16:57:47.798717 run osmo-hlr_10.42.42.2(pid=25133): stderr: | [0;m[1;31m20221209165744429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165744429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165744429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165744429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165744429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165744429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165744441 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165744449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165744450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165744450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:47.873212 run osmo-msc_10.42.42.6(pid=25139): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25139)] 16:57:47.923478 run osmo-msc_10.42.42.6(pid=25139): stdout: | (launched: 2022-12-09_16:57:46.295244) 16:57:47.975266 run osmo-msc_10.42.42.6(pid=25139): stderr: | [0;m[38;5;43m20221209165746876 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165746876 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f589aca1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165746877 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165746877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165746877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165746877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165746880 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165746881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165746881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165746881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:48.027538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25132): Terminating (SIGTERM) 16:57:48.068580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25135): Terminating (SIGTERM) 16:57:48.112151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25138): Terminating (SIGTERM) 16:57:48.154755 --- ParallelTerminationStrategy: PID 25132 died... 16:57:48.174611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25132): Terminated: ok {rc=0} 16:57:48.221887 --- ParallelTerminationStrategy: PID 25135 died... 16:57:48.241319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25135): Terminated: ok {rc=0} 16:57:48.288573 --- ParallelTerminationStrategy: PID 25138 died... 16:57:48.308070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25138): Terminated: ok {rc=0} 16:57:48.396570 bus /sierra_3: Setting Powered False 16:57:49.495182 bus /sierra_3: Setting Powered False 16:57:50.609226 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 16:57:51.872855 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:51.878503 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 16:57:51.918523 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 16:57:51.947321 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 16:57:52.001364 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 16:57:52.038918 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 16:57:52.066234 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 16:57:52.617719 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 16:57:52.623109 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:52.634406 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 16:57:52.668488 tst handover.py: using LAC 22450 16:57:52.795933 tst handover.py: using RAC 10 16:57:52.923428 tst handover.py: using CellId 22450 16:57:53.050980 tst handover.py: using BVCI 22451 16:57:53.169546 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 16:57:53.205323 tst handover.py: using LAC 22451 16:57:53.327424 tst handover.py: using RAC 11 16:57:53.457707 tst handover.py: using CellId 22451 16:57:53.585443 tst handover.py: using BVCI 22452 16:57:53.697646 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:53.708506 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:53.719416 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:53.730933 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:53.742368 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:57:53.753629 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 16:57:53.870596 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 16:57:53.991112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:54.436741 run create_hlr_db(pid=25144): Launched 16:57:54.562161 bus /sierra_2: Setting Powered False 16:57:55.622480 run create_hlr_db(pid=25144): Terminated: ok {rc=0} 16:57:56.039193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25146): Launched 16:57:56.365611 run osmo-hlr_10.42.42.2(pid=25147): Launched 16:57:56.490037 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:57.025229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25149): Launched 16:57:57.350425 run osmo-stp_10.42.42.5(pid=25150): Launched 16:57:57.474765 run osmo-msc_10.42.42.6: Starting osmo-msc 16:57:58.035397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25152): Launched 16:57:58.362295 run osmo-msc_10.42.42.6(pid=25153): Launched 16:57:58.544101 run osmo-stp_10.42.42.5(pid=25150): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25150)] 16:57:58.682557 run osmo-stp_10.42.42.5(pid=25150): stdout: | (launched: 2022-12-09_16:57:57.291404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:58.820113 run osmo-stp_10.42.42.5(pid=25150): stderr: | [0;m[38;5;43m20221209165757485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165757485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165757485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165757486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165757486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165757486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165757486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:58.957246 run osmo-stp_10.42.42.5(pid=25150): stdout: | (launched: 2022-12-09_16:57:57.291404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:59.087987 run osmo-stp_10.42.42.5(pid=25150): stderr: | [0;m[38;5;43m20221209165757485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165757485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165757485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165757486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165757486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165757486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165757486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:59.243810 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25150): Process ended prematurely: osmo-stp_10.42.42.5(pid=25150) [trial-2361↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25150)] [trial-2361↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 16:57:59.252562 tst handover.py:18: Test FAILED (6.6 sec) 16:57:59.280006 run osmo-hlr_10.42.42.2(pid=25147): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25147)] 16:57:59.330448 run osmo-hlr_10.42.42.2(pid=25147): stdout: | (launched: 2022-12-09_16:57:56.306070) 16:57:59.382329 run osmo-hlr_10.42.42.2(pid=25147): stderr: | [0;m[1;31m20221209165756507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165756507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165756507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165756507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165756507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165756507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165756520 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165756528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165756528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165756528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:59.454276 run osmo-msc_10.42.42.6(pid=25153): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25153)] 16:57:59.504039 run osmo-msc_10.42.42.6(pid=25153): stdout: | (launched: 2022-12-09_16:57:58.302986) 16:57:59.555362 run osmo-msc_10.42.42.6(pid=25153): stderr: | [0;m[38;5;43m20221209165758626 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165758626 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1843f52c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165758627 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165758627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165758627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165758627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165758629 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165758629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165758629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165758629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:57:59.607548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25146): Terminating (SIGTERM) 16:57:59.649164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25149): Terminating (SIGTERM) 16:57:59.690305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25152): Terminating (SIGTERM) 16:57:59.732302 --- ParallelTerminationStrategy: PID 25146 died... 16:57:59.752154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25146): Terminated: ok {rc=0} 16:57:59.798215 --- ParallelTerminationStrategy: PID 25149 died... 16:57:59.817536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25149): Terminated: ok {rc=0} 16:57:59.863731 --- ParallelTerminationStrategy: PID 25152 died... 16:57:59.883086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25152): Terminated: ok {rc=0} 16:57:59.970837 bus /sierra_3: Setting Powered False 16:58:01.076325 bus /sierra_3: Setting Powered False 16:58:02.192625 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 16:58:03.431744 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:03.437157 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 16:58:03.485586 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 16:58:03.512035 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 16:58:03.564113 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 16:58:03.612174 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 16:58:03.638744 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 16:58:04.189862 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 16:58:04.195012 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:58:04.205996 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:58:04.238940 tst handover.py: using LAC 22452 16:58:04.358168 tst handover.py: using RAC 12 16:58:04.477145 tst handover.py: using CellId 22452 16:58:04.595950 tst handover.py: using BVCI 22453 16:58:04.707563 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:58:04.756197 tst handover.py: using LAC 22453 16:58:04.877391 tst handover.py: using RAC 13 16:58:04.997408 tst handover.py: using CellId 22453 16:58:05.117138 tst handover.py: using BVCI 22454 16:58:05.228831 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:58:05.239662 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:58:05.250418 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:58:05.261204 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:58:05.272000 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:58:05.282519 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:58:05.398966 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:58:05.515799 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:05.962743 run create_hlr_db(pid=25158): Launched 16:58:06.088167 bus /sierra_2: Setting Powered False 16:58:07.149628 run create_hlr_db(pid=25158): Terminated: ok {rc=0} 16:58:07.566782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25160): Launched 16:58:07.894843 run osmo-hlr_10.42.42.2(pid=25161): Launched 16:58:08.019429 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:08.550509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25163): Launched 16:58:08.879071 run osmo-stp_10.42.42.5(pid=25164): Launched 16:58:09.004193 run osmo-msc_10.42.42.6: Starting osmo-msc 16:58:09.563846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25166): Launched 16:58:09.892630 run osmo-msc_10.42.42.6(pid=25167): Launched 16:58:10.075534 run osmo-stp_10.42.42.5(pid=25164): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25164)] 16:58:10.212869 run osmo-stp_10.42.42.5(pid=25164): stdout: | (launched: 2022-12-09_16:58:08.819967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:10.350680 run osmo-stp_10.42.42.5(pid=25164): stderr: | [0;m[38;5;43m20221209165809011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165809011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165809011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165809012 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165809014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165809014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165809014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:10.487682 run osmo-stp_10.42.42.5(pid=25164): stdout: | (launched: 2022-12-09_16:58:08.819967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:10.618418 run osmo-stp_10.42.42.5(pid=25164): stderr: | [0;m[38;5;43m20221209165809011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165809011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165809011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165809012 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165809014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165809014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165809014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:10.774529 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25164): Process ended prematurely: osmo-stp_10.42.42.5(pid=25164) [trial-2361↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25164)] [trial-2361↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 16:58:10.783304 tst handover.py:18: Test FAILED (6.6 sec) 16:58:10.810827 run osmo-hlr_10.42.42.2(pid=25161): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25161)] 16:58:10.861073 run osmo-hlr_10.42.42.2(pid=25161): stdout: | (launched: 2022-12-09_16:58:07.836000) 16:58:10.912477 run osmo-hlr_10.42.42.2(pid=25161): stderr: | [0;m[1;31m20221209165808033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165808033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165808033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165808033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165808033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165808033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165808046 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165808054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165808054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165808054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:10.984390 run osmo-msc_10.42.42.6(pid=25167): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25167)] 16:58:11.034155 run osmo-msc_10.42.42.6(pid=25167): stdout: | (launched: 2022-12-09_16:58:09.833297) 16:58:11.085597 run osmo-msc_10.42.42.6(pid=25167): stderr: | [0;m[38;5;43m20221209165810154 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165810154 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa6228ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165810154 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165810154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165810154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165810155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165810156 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165810157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165810157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165810157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:11.137529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25160): Terminating (SIGTERM) 16:58:11.178922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25163): Terminating (SIGTERM) 16:58:11.220566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25166): Terminating (SIGTERM) 16:58:11.262419 --- ParallelTerminationStrategy: PID 25160 died... 16:58:11.282157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25160): Terminated: ok {rc=0} 16:58:11.328093 --- ParallelTerminationStrategy: PID 25163 died... 16:58:11.347407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25163): Terminated: ok {rc=0} 16:58:11.393128 --- ParallelTerminationStrategy: PID 25166 died... 16:58:11.412240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25166): Terminated: ok {rc=0} 16:58:11.499297 bus /sierra_3: Setting Powered False 16:58:12.598356 bus /sierra_3: Setting Powered False 16:58:13.713846 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 16:58:14.970611 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:14.976216 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 16:58:15.024672 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:58:15.051288 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 16:58:15.103773 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 16:58:15.151754 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:58:15.178261 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 16:58:15.729995 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 16:58:15.736852 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:15.749247 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:58:15.785116 tst handover.py: using LAC 22454 16:58:15.929486 tst handover.py: using RAC 14 16:58:16.071278 tst handover.py: using CellId 22454 16:58:16.194094 tst handover.py: using BVCI 22455 16:58:16.342110 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:58:16.390261 tst handover.py: using LAC 22455 16:58:16.546858 tst handover.py: using RAC 15 16:58:16.719436 tst handover.py: using CellId 22455 16:58:16.863584 tst handover.py: using BVCI 22456 16:58:17.009877 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:17.022521 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:17.036250 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:17.049179 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:17.062528 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:58:17.076396 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:58:17.207156 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:58:17.330714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:17.810153 run create_hlr_db(pid=25172): Launched 16:58:17.936206 bus /sierra_2: Setting Powered False 16:58:19.001187 run create_hlr_db(pid=25172): Terminated: ok {rc=0} 16:58:19.411179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25174): Launched 16:58:19.719155 run osmo-hlr_10.42.42.2(pid=25175): Launched 16:58:19.835579 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:20.334121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25177): Launched 16:58:20.638524 run osmo-stp_10.42.42.5(pid=25178): Launched 16:58:20.755114 run osmo-msc_10.42.42.6: Starting osmo-msc 16:58:21.280253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25180): Launched 16:58:21.586884 run osmo-msc_10.42.42.6(pid=25181): Launched 16:58:21.757423 run osmo-stp_10.42.42.5(pid=25178): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25178)] 16:58:21.887239 run osmo-stp_10.42.42.5(pid=25178): stdout: | (launched: 2022-12-09_16:58:20.582562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:22.015939 run osmo-stp_10.42.42.5(pid=25178): stderr: | [0;m[38;5;43m20221209165820754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165820755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165820755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165820755 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165820756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165820756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165820756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:22.142768 run osmo-stp_10.42.42.5(pid=25178): stdout: | (launched: 2022-12-09_16:58:20.582562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:22.264060 run osmo-stp_10.42.42.5(pid=25178): stderr: | [0;m[38;5;43m20221209165820754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165820755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165820755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165820755 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165820756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165820756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165820756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:22.409781 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25178): Process ended prematurely: osmo-stp_10.42.42.5(pid=25178) [trial-2361↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25178)] [trial-2361↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 16:58:22.418227 tst handover.py:18: Test FAILED (6.7 sec) 16:58:22.444035 run osmo-hlr_10.42.42.2(pid=25175): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25175)] 16:58:22.491262 run osmo-hlr_10.42.42.2(pid=25175): stdout: | (launched: 2022-12-09_16:58:19.663447) 16:58:22.540865 run osmo-hlr_10.42.42.2(pid=25175): stderr: | [0;m[1;31m20221209165819842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165819842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165819842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165819842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165819842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165819842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165819857 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165819867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165819867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165819867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:22.609610 run osmo-msc_10.42.42.6(pid=25181): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25181)] 16:58:22.657145 run osmo-msc_10.42.42.6(pid=25181): stdout: | (launched: 2022-12-09_16:58:21.531125) 16:58:22.706124 run osmo-msc_10.42.42.6(pid=25181): stderr: | [0;m[38;5;43m20221209165821803 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165821803 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa228d32c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165821803 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165821803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165821803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165821803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165821805 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165821806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165821806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165821806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:22.755228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25174): Terminating (SIGTERM) 16:58:22.794610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25177): Terminating (SIGTERM) 16:58:22.834028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25180): Terminating (SIGTERM) 16:58:22.873953 --- ParallelTerminationStrategy: PID 25174 died... 16:58:22.893075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25174): Terminated: ok {rc=0} 16:58:22.937064 --- ParallelTerminationStrategy: PID 25177 died... 16:58:22.955535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25177): Terminated: ok {rc=0} 16:58:22.999366 --- ParallelTerminationStrategy: PID 25180 died... 16:58:23.018005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25180): Terminated: ok {rc=0} 16:58:23.103569 bus /sierra_3: Setting Powered False 16:58:24.203878 bus /sierra_3: Setting Powered False 16:58:25.318216 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 16:58:26.567136 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:26.574124 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 16:58:26.636556 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:58:26.664823 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:58:26.718259 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 16:58:26.779070 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:58:26.806790 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:58:27.359620 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 16:58:27.365573 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:27.377196 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:58:27.426792 tst handover.py: using LAC 22456 16:58:27.555543 tst handover.py: using RAC 16 16:58:27.683487 tst handover.py: using CellId 22456 16:58:27.810644 tst handover.py: using BVCI 22457 16:58:27.928821 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 16:58:27.974000 tst handover.py: using LAC 22457 16:58:28.103513 tst handover.py: using RAC 17 16:58:28.232186 tst handover.py: using CellId 22457 16:58:28.360650 tst handover.py: using BVCI 22458 16:58:28.479139 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:28.490892 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:28.502421 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:28.514441 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:28.526378 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:58:28.538229 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:58:28.655068 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:58:28.769761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:29.214931 run create_hlr_db(pid=25186): Launched 16:58:29.341615 bus /sierra_2: Setting Powered False 16:58:30.402677 run create_hlr_db(pid=25186): Terminated: ok {rc=0} 16:58:30.822198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25189): Launched 16:58:31.174399 run osmo-hlr_10.42.42.2(pid=25190): Launched 16:58:31.417421 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:32.056388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25192): Launched 16:58:32.377400 run osmo-stp_10.42.42.5(pid=25193): Launched 16:58:32.493965 run osmo-msc_10.42.42.6: Starting osmo-msc 16:58:33.016455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25195): Launched 16:58:33.321789 run osmo-msc_10.42.42.6(pid=25196): Launched 16:58:33.494408 run osmo-stp_10.42.42.5(pid=25193): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25193)] 16:58:33.623942 run osmo-stp_10.42.42.5(pid=25193): stdout: | (launched: 2022-12-09_16:58:32.321765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:33.753048 run osmo-stp_10.42.42.5(pid=25193): stderr: | [0;m[38;5;43m20221209165832493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165832493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165832493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165832494 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165832494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165832494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165832494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:33.879957 run osmo-stp_10.42.42.5(pid=25193): stdout: | (launched: 2022-12-09_16:58:32.321765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:34.002054 run osmo-stp_10.42.42.5(pid=25193): stderr: | [0;m[38;5;43m20221209165832493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165832493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165832493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165832494 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165832494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165832494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165832494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:34.149093 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25193): Process ended prematurely: osmo-stp_10.42.42.5(pid=25193) [trial-2361↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25193)] [trial-2361↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 16:58:34.157303 tst handover.py:18: Test FAILED (6.8 sec) 16:58:34.183170 run osmo-hlr_10.42.42.2(pid=25190): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25190)] 16:58:34.230201 run osmo-hlr_10.42.42.2(pid=25190): stdout: | (launched: 2022-12-09_16:58:31.112036) 16:58:34.279509 run osmo-hlr_10.42.42.2(pid=25190): stderr: | [0;m[1;31m20221209165831418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165831418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165831418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165831418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165831418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165831418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165831431 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165831439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165831439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165831439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:34.347948 run osmo-msc_10.42.42.6(pid=25196): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25196)] 16:58:34.395083 run osmo-msc_10.42.42.6(pid=25196): stdout: | (launched: 2022-12-09_16:58:33.266109) 16:58:34.444088 run osmo-msc_10.42.42.6(pid=25196): stderr: | [0;m[38;5;43m20221209165833537 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165833537 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe1dbdeac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165833537 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165833538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165833538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165833538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165833539 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165833540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165833540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165833540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:34.493230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25189): Terminating (SIGTERM) 16:58:34.532450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25192): Terminating (SIGTERM) 16:58:34.571917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25195): Terminating (SIGTERM) 16:58:34.611545 --- ParallelTerminationStrategy: PID 25189 died... 16:58:34.630480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25189): Terminated: ok {rc=0} 16:58:34.674322 --- ParallelTerminationStrategy: PID 25192 died... 16:58:34.692620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25192): Terminated: ok {rc=0} 16:58:34.736114 --- ParallelTerminationStrategy: PID 25195 died... 16:58:34.754619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25195): Terminated: ok {rc=0} 16:58:34.839822 bus /sierra_3: Setting Powered False 16:58:35.939175 bus /sierra_3: Setting Powered False 16:58:37.054391 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 16:58:38.320266 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:38.325364 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 16:58:38.388230 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:58:38.414859 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:58:38.467643 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 16:58:38.530878 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:58:38.557692 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:58:39.107724 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 16:58:39.113144 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:39.124205 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:58:39.171980 tst handover.py: using LAC 22458 16:58:39.293155 tst handover.py: using RAC 18 16:58:39.413208 tst handover.py: using CellId 22458 16:58:39.532532 tst handover.py: using BVCI 22459 16:58:39.642424 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:58:39.691517 tst handover.py: using LAC 22459 16:58:39.811927 tst handover.py: using RAC 19 16:58:39.931849 tst handover.py: using CellId 22459 16:58:40.051633 tst handover.py: using BVCI 22460 16:58:40.163559 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:40.174577 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:40.185464 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:40.196203 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:40.207233 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:58:40.218204 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:58:40.333768 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:58:40.456385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:40.903101 run create_hlr_db(pid=25201): Launched 16:58:41.028033 bus /sierra_2: Setting Powered False 16:58:42.089537 run create_hlr_db(pid=25201): Terminated: ok {rc=0} 16:58:42.488848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25203): Launched 16:58:42.793631 run osmo-hlr_10.42.42.2(pid=25204): Launched 16:58:42.909136 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:43.402563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25206): Launched 16:58:43.706848 run osmo-stp_10.42.42.5(pid=25207): Launched 16:58:43.822589 run osmo-msc_10.42.42.6: Starting osmo-msc 16:58:44.346199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25209): Launched 16:58:44.653461 run osmo-msc_10.42.42.6(pid=25210): Launched 16:58:44.823774 run osmo-stp_10.42.42.5(pid=25207): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25207)] 16:58:44.952527 run osmo-stp_10.42.42.5(pid=25207): stdout: | (launched: 2022-12-09_16:58:43.651156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:45.080354 run osmo-stp_10.42.42.5(pid=25207): stderr: | [0;m[38;5;43m20221209165843822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165843822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165843822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165843823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165843823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165843823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165843823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:45.206833 run osmo-stp_10.42.42.5(pid=25207): stdout: | (launched: 2022-12-09_16:58:43.651156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:45.327989 run osmo-stp_10.42.42.5(pid=25207): stderr: | [0;m[38;5;43m20221209165843822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165843822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165843822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165843823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165843823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165843823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165843823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:45.473138 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25207): Process ended prematurely: osmo-stp_10.42.42.5(pid=25207) [trial-2361↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25207)] [trial-2361↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 16:58:45.481530 tst handover.py:18: Test FAILED (6.4 sec) 16:58:45.507293 run osmo-hlr_10.42.42.2(pid=25204): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25204)] 16:58:45.554366 run osmo-hlr_10.42.42.2(pid=25204): stdout: | (launched: 2022-12-09_16:58:42.737930) 16:58:45.603355 run osmo-hlr_10.42.42.2(pid=25204): stderr: | [0;m[1;31m20221209165842915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165842915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165842915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165842915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165842915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165842915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165842928 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165842936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165842937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165842937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:45.671772 run osmo-msc_10.42.42.6(pid=25210): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25210)] 16:58:45.718963 run osmo-msc_10.42.42.6(pid=25210): stdout: | (launched: 2022-12-09_16:58:44.597601) 16:58:45.767740 run osmo-msc_10.42.42.6(pid=25210): stderr: | [0;m[38;5;43m20221209165844870 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165844870 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f88579a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165844870 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165844870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165844870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165844871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165844872 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165844873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165844873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165844873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:45.817224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25203): Terminating (SIGTERM) 16:58:45.863394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25206): Terminating (SIGTERM) 16:58:45.925155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25209): Terminating (SIGTERM) 16:58:45.971402 --- ParallelTerminationStrategy: PID 25203 died... 16:58:45.993591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25203): Terminated: ok {rc=0} 16:58:46.045556 --- ParallelTerminationStrategy: PID 25206 died... 16:58:46.066204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25206): Terminated: ok {rc=0} 16:58:46.115922 --- ParallelTerminationStrategy: PID 25209 died... 16:58:46.136573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25209): Terminated: ok {rc=0} 16:58:46.228906 bus /sierra_3: Setting Powered False 16:58:47.331081 bus /sierra_3: Setting Powered False 16:58:48.446564 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 16:58:49.720103 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:49.725806 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 16:58:49.778343 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 16:58:49.806032 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 16:58:49.859454 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 16:58:49.911237 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 16:58:49.938742 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 16:58:50.489511 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 16:58:50.494966 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:58:50.506348 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 16:58:50.555353 tst handover.py: using LAC 22460 16:58:50.684724 tst handover.py: using RAC 20 16:58:50.813434 tst handover.py: using CellId 22460 16:58:50.934619 tst handover.py: using BVCI 22461 16:58:51.047620 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 16:58:51.082884 tst handover.py: using LAC 22461 16:58:51.203558 tst handover.py: using RAC 21 16:58:51.323716 tst handover.py: using CellId 22461 16:58:51.449191 tst handover.py: using BVCI 22462 16:58:51.561351 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:58:51.572461 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:58:51.583404 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:58:51.594618 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:58:51.605970 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:58:51.617176 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 16:58:51.736860 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 16:58:51.852515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:52.299644 run create_hlr_db(pid=25215): Launched 16:58:52.423740 bus /sierra_2: Setting Powered False 16:58:53.486898 run create_hlr_db(pid=25215): Terminated: ok {rc=0} 16:58:53.897733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25217): Launched 16:58:54.202065 run osmo-hlr_10.42.42.2(pid=25218): Launched 16:58:54.318908 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:54.821461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25220): Launched 16:58:55.126091 run osmo-stp_10.42.42.5(pid=25221): Launched 16:58:55.242496 run osmo-msc_10.42.42.6: Starting osmo-msc 16:58:55.768152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25223): Launched 16:58:56.073802 run osmo-msc_10.42.42.6(pid=25224): Launched 16:58:56.244240 run osmo-stp_10.42.42.5(pid=25221): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25221)] 16:58:56.373763 run osmo-stp_10.42.42.5(pid=25221): stdout: | (launched: 2022-12-09_16:58:55.070256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:56.502198 run osmo-stp_10.42.42.5(pid=25221): stderr: | [0;m[38;5;43m20221209165855241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165855241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165855241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165855242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165855242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165855242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165855242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:56.628700 run osmo-stp_10.42.42.5(pid=25221): stdout: | (launched: 2022-12-09_16:58:55.070256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:56.750013 run osmo-stp_10.42.42.5(pid=25221): stderr: | [0;m[38;5;43m20221209165855241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165855241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165855241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165855242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165855242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165855242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165855242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:56.895313 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25221): Process ended prematurely: osmo-stp_10.42.42.5(pid=25221) [trial-2361↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25221)] [trial-2361↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 16:58:56.903661 tst handover.py:18: Test FAILED (6.4 sec) 16:58:56.929692 run osmo-hlr_10.42.42.2(pid=25218): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25218)] 16:58:56.977316 run osmo-hlr_10.42.42.2(pid=25218): stdout: | (launched: 2022-12-09_16:58:54.146488) 16:58:57.026168 run osmo-hlr_10.42.42.2(pid=25218): stderr: | [0;m[1;31m20221209165854323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165854323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165854323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165854323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165854323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165854323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165854335 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165854346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165854346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165854346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:57.094268 run osmo-msc_10.42.42.6(pid=25224): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25224)] 16:58:57.141286 run osmo-msc_10.42.42.6(pid=25224): stdout: | (launched: 2022-12-09_16:58:56.018011) 16:58:57.189478 run osmo-msc_10.42.42.6(pid=25224): stderr: | [0;m[38;5;43m20221209165856290 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165856290 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe427d55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165856290 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165856290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165856291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165856291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165856292 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165856293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165856293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165856293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:58:57.239849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25217): Terminating (SIGTERM) 16:58:57.278770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25220): Terminating (SIGTERM) 16:58:57.317887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25223): Terminating (SIGTERM) 16:58:57.357387 --- ParallelTerminationStrategy: PID 25217 died... 16:58:57.376115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25217): Terminated: ok {rc=0} 16:58:57.419775 --- ParallelTerminationStrategy: PID 25220 died... 16:58:57.438288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25220): Terminated: ok {rc=0} 16:58:57.481873 --- ParallelTerminationStrategy: PID 25223 died... 16:58:57.500416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25223): Terminated: ok {rc=0} 16:58:57.583364 bus /sierra_3: Setting Powered False 16:58:58.680568 bus /sierra_3: Setting Powered False 16:58:59.795411 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 16:59:01.068097 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:01.073796 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 16:59:01.158068 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 16:59:01.195875 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 16:59:01.269800 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 16:59:01.356913 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 16:59:01.394683 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 16:59:01.941613 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 16:59:01.950071 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:01.963287 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:59:02.019466 tst handover.py: using LAC 22462 16:59:02.149367 tst handover.py: using RAC 22 16:59:02.271474 tst handover.py: using CellId 22462 16:59:02.392724 tst handover.py: using BVCI 22463 16:59:02.502669 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:59:02.552333 tst handover.py: using LAC 22463 16:59:02.671566 tst handover.py: using RAC 23 16:59:02.789979 tst handover.py: using CellId 22463 16:59:02.918637 tst handover.py: using BVCI 22464 16:59:03.037565 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:03.048759 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:03.060079 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:03.072077 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:03.084080 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:03.095975 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:59:03.213414 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:59:03.333570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:03.785724 run create_hlr_db(pid=25229): Launched 16:59:03.910879 bus /sierra_2: Setting Powered False 16:59:04.971768 run create_hlr_db(pid=25229): Terminated: ok {rc=0} 16:59:05.390698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25231): Launched 16:59:05.720906 run osmo-hlr_10.42.42.2(pid=25232): Launched 16:59:05.848194 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:06.381498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25234): Launched 16:59:06.710321 run osmo-stp_10.42.42.5(pid=25235): Launched 16:59:06.836351 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:07.403238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25237): Launched 16:59:07.716491 run osmo-msc_10.42.42.6(pid=25238): Launched 16:59:07.887336 run osmo-stp_10.42.42.5(pid=25235): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25235)] 16:59:08.016323 run osmo-stp_10.42.42.5(pid=25235): stdout: | (launched: 2022-12-09_16:59:06.650573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:08.144567 run osmo-stp_10.42.42.5(pid=25235): stderr: | [0;m[38;5;43m20221209165906843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165906843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165906843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165906844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165906846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165906846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165906846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:08.272067 run osmo-stp_10.42.42.5(pid=25235): stdout: | (launched: 2022-12-09_16:59:06.650573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:08.394940 run osmo-stp_10.42.42.5(pid=25235): stderr: | [0;m[38;5;43m20221209165906843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165906843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165906843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165906844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165906846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165906846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165906846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:08.540533 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25235): Process ended prematurely: osmo-stp_10.42.42.5(pid=25235) [trial-2361↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25235)] [trial-2361↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 16:59:08.548880 tst handover.py:18: Test FAILED (6.6 sec) 16:59:08.575220 run osmo-hlr_10.42.42.2(pid=25232): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25232)] 16:59:08.622620 run osmo-hlr_10.42.42.2(pid=25232): stdout: | (launched: 2022-12-09_16:59:05.661532) 16:59:08.671573 run osmo-hlr_10.42.42.2(pid=25232): stderr: | [0;m[1;31m20221209165905860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165905860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165905860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165905860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165905860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165905860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165905872 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165905880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165905880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165905880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:08.739714 run osmo-msc_10.42.42.6(pid=25238): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25238)] 16:59:08.786987 run osmo-msc_10.42.42.6(pid=25238): stdout: | (launched: 2022-12-09_16:59:07.660188) 16:59:08.835298 run osmo-msc_10.42.42.6(pid=25238): stderr: | [0;m[38;5;43m20221209165907934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165907934 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb266f43c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165907934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165907934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165907934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165907934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165907936 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165907937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165907937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165907937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:08.884285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25231): Terminating (SIGTERM) 16:59:08.923680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25234): Terminating (SIGTERM) 16:59:08.963266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25237): Terminating (SIGTERM) 16:59:09.003422 --- ParallelTerminationStrategy: PID 25231 died... 16:59:09.022385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25231): Terminated: ok {rc=0} 16:59:09.066145 --- ParallelTerminationStrategy: PID 25234 died... 16:59:09.084547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25234): Terminated: ok {rc=0} 16:59:09.128257 --- ParallelTerminationStrategy: PID 25237 died... 16:59:09.147016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25237): Terminated: ok {rc=0} 16:59:09.232148 bus /sierra_3: Setting Powered False 16:59:10.331886 bus /sierra_3: Setting Powered False 16:59:11.447805 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 16:59:12.725358 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:12.731137 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 16:59:12.795555 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:59:12.823513 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 16:59:12.878161 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 16:59:12.943914 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:59:12.971744 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 16:59:13.519844 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 16:59:13.525773 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:13.537319 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:59:13.587402 tst handover.py: using LAC 22464 16:59:13.717245 tst handover.py: using RAC 24 16:59:13.846732 tst handover.py: using CellId 22464 16:59:13.976254 tst handover.py: using BVCI 22465 16:59:14.094828 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 16:59:14.143393 tst handover.py: using LAC 22465 16:59:14.272818 tst handover.py: using RAC 25 16:59:14.401421 tst handover.py: using CellId 22465 16:59:14.522712 tst handover.py: using BVCI 22466 16:59:14.635019 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:14.646177 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:14.656930 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:14.668229 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:14.679218 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 16:59:14.690337 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:59:14.810713 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 16:59:14.931028 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:15.410028 run create_hlr_db(pid=25243): Launched 16:59:15.537367 bus /sierra_2: Setting Powered False 16:59:16.601741 run create_hlr_db(pid=25243): Terminated: ok {rc=0} 16:59:17.037241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25245): Launched 16:59:17.370694 run osmo-hlr_10.42.42.2(pid=25246): Launched 16:59:17.500015 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:18.033213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25248): Launched 16:59:18.360411 run osmo-stp_10.42.42.5(pid=25249): Launched 16:59:18.486513 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:19.049384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25251): Launched 16:59:19.377255 run osmo-msc_10.42.42.6(pid=25252): Launched 16:59:19.561203 run osmo-stp_10.42.42.5(pid=25249): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25249)] 16:59:19.699467 run osmo-stp_10.42.42.5(pid=25249): stdout: | (launched: 2022-12-09_16:59:18.300537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:19.838076 run osmo-stp_10.42.42.5(pid=25249): stderr: | [0;m[38;5;43m20221209165918497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165918497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165918498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165918498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165918499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165918499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165918499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:19.975240 run osmo-stp_10.42.42.5(pid=25249): stdout: | (launched: 2022-12-09_16:59:18.300537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:20.106063 run osmo-stp_10.42.42.5(pid=25249): stderr: | [0;m[38;5;43m20221209165918497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165918497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165918498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165918498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165918499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165918499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165918499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:20.262205 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25249): Process ended prematurely: osmo-stp_10.42.42.5(pid=25249) [trial-2361↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25249)] [trial-2361↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 16:59:20.271196 tst handover.py:18: Test FAILED (6.7 sec) 16:59:20.298756 run osmo-hlr_10.42.42.2(pid=25246): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25246)] 16:59:20.349097 run osmo-hlr_10.42.42.2(pid=25246): stdout: | (launched: 2022-12-09_16:59:17.311454) 16:59:20.400515 run osmo-hlr_10.42.42.2(pid=25246): stderr: | [0;m[1;31m20221209165917510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165917510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165917510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165917510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165917510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165917510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165917523 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165917531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165917531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165917531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:20.472466 run osmo-msc_10.42.42.6(pid=25252): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25252)] 16:59:20.522074 run osmo-msc_10.42.42.6(pid=25252): stdout: | (launched: 2022-12-09_16:59:19.317718) 16:59:20.573268 run osmo-msc_10.42.42.6(pid=25252): stderr: | [0;m[38;5;43m20221209165919640 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165919640 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd967636c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165919640 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165919640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165919641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165919641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165919642 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165919643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165919643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165919643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:20.625132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25245): Terminating (SIGTERM) 16:59:20.667070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25248): Terminating (SIGTERM) 16:59:20.708884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25251): Terminating (SIGTERM) 16:59:20.751208 --- ParallelTerminationStrategy: PID 25245 died... 16:59:20.771289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25245): Terminated: ok {rc=0} 16:59:20.818149 --- ParallelTerminationStrategy: PID 25248 died... 16:59:20.837735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25248): Terminated: ok {rc=0} 16:59:20.884081 --- ParallelTerminationStrategy: PID 25251 died... 16:59:20.903702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25251): Terminated: ok {rc=0} 16:59:20.991702 bus /sierra_3: Setting Powered False 16:59:22.090612 bus /sierra_3: Setting Powered False 16:59:23.209177 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 16:59:24.476901 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:24.482155 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 16:59:24.542344 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:59:24.569306 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:59:24.623195 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 16:59:24.686520 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:59:24.714360 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:59:25.261540 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 16:59:25.267063 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:59:25.278625 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:59:25.328172 tst handover.py: using LAC 22466 16:59:25.456229 tst handover.py: using RAC 26 16:59:25.582193 tst handover.py: using CellId 22466 16:59:25.708332 tst handover.py: using BVCI 22467 16:59:25.826714 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 16:59:25.875512 tst handover.py: using LAC 22467 16:59:25.995477 tst handover.py: using RAC 27 16:59:26.113982 tst handover.py: using CellId 22467 16:59:26.232277 tst handover.py: using BVCI 22468 16:59:26.342454 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:59:26.354128 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:59:26.365398 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:59:26.376762 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:59:26.388055 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:59:26.399194 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:59:26.516723 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:59:26.634214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:27.081433 run create_hlr_db(pid=25258): Launched 16:59:27.207137 bus /sierra_2: Setting Powered False 16:59:28.267543 run create_hlr_db(pid=25258): Terminated: ok {rc=0} 16:59:28.668170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25260): Launched 16:59:28.973912 run osmo-hlr_10.42.42.2(pid=25261): Launched 16:59:29.090274 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:29.588642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25264): Launched 16:59:29.894275 run osmo-stp_10.42.42.5(pid=25265): Launched 16:59:30.012859 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:30.555837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25267): Launched 16:59:30.869972 run osmo-msc_10.42.42.6(pid=25268): Launched 16:59:31.303303 run osmo-stp_10.42.42.5(pid=25265): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25265)] 16:59:31.728053 run osmo-stp_10.42.42.5(pid=25265): stdout: | (launched: 2022-12-09_16:59:29.838299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:31.943797 run osmo-stp_10.42.42.5(pid=25265): stderr: | [0;m[38;5;43m20221209165930010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165930010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165930011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165930011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165930011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165930011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165930011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:32.074246 run osmo-stp_10.42.42.5(pid=25265): stdout: | (launched: 2022-12-09_16:59:29.838299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:32.199522 run osmo-stp_10.42.42.5(pid=25265): stderr: | [0;m[38;5;43m20221209165930010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165930010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165930011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165930011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165930011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165930011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165930011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:32.348451 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25265): Process ended prematurely: osmo-stp_10.42.42.5(pid=25265) [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25265)] [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 16:59:32.357799 tst handover.py:18: Test FAILED (7.1 sec) 16:59:32.385139 run osmo-hlr_10.42.42.2(pid=25261): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25261)] 16:59:32.432739 run osmo-hlr_10.42.42.2(pid=25261): stdout: | (launched: 2022-12-09_16:59:28.918179) 16:59:32.482120 run osmo-hlr_10.42.42.2(pid=25261): stderr: | [0;m[1;31m20221209165929096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165929096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165929096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165929096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165929096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165929096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165929109 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165929118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165929118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165929118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:32.550911 run osmo-msc_10.42.42.6(pid=25268): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25268)] 16:59:32.598685 run osmo-msc_10.42.42.6(pid=25268): stdout: | (launched: 2022-12-09_16:59:30.805582) 16:59:32.647558 run osmo-msc_10.42.42.6(pid=25268): stderr: | [0;m[38;5;43m20221209165931440 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165931441 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff424e3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165931441 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165931441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165931442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165931442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165931446 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165931447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165931447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165931447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:32.696692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25260): Terminating (SIGTERM) 16:59:32.735733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25264): Terminating (SIGTERM) 16:59:32.774806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25267): Terminating (SIGTERM) 16:59:32.814220 --- ParallelTerminationStrategy: PID 25260 died... 16:59:32.833140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25260): Terminated: ok {rc=0} 16:59:32.877079 --- ParallelTerminationStrategy: PID 25264 died... 16:59:32.895514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25264): Terminated: ok {rc=0} 16:59:32.938861 --- ParallelTerminationStrategy: PID 25267 died... 16:59:32.957369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25267): Terminated: ok {rc=0} 16:59:33.042778 bus /sierra_3: Setting Powered False 16:59:34.143566 bus /sierra_3: Setting Powered False 16:59:35.258765 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 16:59:36.531745 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:36.538567 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 16:59:36.588090 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 16:59:36.616234 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 16:59:36.670288 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 16:59:36.718009 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 16:59:36.744918 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 16:59:37.294988 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 16:59:37.300310 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:37.311487 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 16:59:37.356807 tst handover.py: using LAC 22468 16:59:37.474772 tst handover.py: using RAC 28 16:59:37.593373 tst handover.py: using CellId 22468 16:59:37.711458 tst handover.py: using BVCI 22469 16:59:37.823069 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 16:59:37.857016 tst handover.py: using LAC 22469 16:59:37.974125 tst handover.py: using RAC 29 16:59:38.092339 tst handover.py: using CellId 22469 16:59:38.210193 tst handover.py: using BVCI 22470 16:59:38.321349 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:38.332293 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:38.343209 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:38.354200 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:38.365377 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 16:59:38.376244 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 16:59:38.496130 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 16:59:38.617840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:39.096097 run create_hlr_db(pid=25273): Launched 16:59:39.222479 bus /sierra_2: Setting Powered False 16:59:40.286828 run create_hlr_db(pid=25273): Terminated: ok {rc=0} 16:59:40.698072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25275): Launched 16:59:41.003821 run osmo-hlr_10.42.42.2(pid=25276): Launched 16:59:41.121472 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:41.634188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25278): Launched 16:59:41.940206 run osmo-stp_10.42.42.5(pid=25279): Launched 16:59:42.056938 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:42.582023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25281): Launched 16:59:42.887916 run osmo-msc_10.42.42.6(pid=25282): Launched 16:59:43.058386 run osmo-stp_10.42.42.5(pid=25279): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25279)] 16:59:43.187198 run osmo-stp_10.42.42.5(pid=25279): stdout: | (launched: 2022-12-09_16:59:41.884279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:43.316055 run osmo-stp_10.42.42.5(pid=25279): stderr: | [0;m[38;5;43m20221209165942057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165942057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165942057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165942058 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165942058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165942058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165942058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:43.443201 run osmo-stp_10.42.42.5(pid=25279): stdout: | (launched: 2022-12-09_16:59:41.884279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:43.564647 run osmo-stp_10.42.42.5(pid=25279): stderr: | [0;m[38;5;43m20221209165942057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165942057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165942057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165942058 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165942058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165942058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165942058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:43.711087 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25279): Process ended prematurely: osmo-stp_10.42.42.5(pid=25279) [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25279)] [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 16:59:43.719279 tst handover.py:18: Test FAILED (6.4 sec) 16:59:43.746097 run osmo-hlr_10.42.42.2(pid=25276): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25276)] 16:59:43.793792 run osmo-hlr_10.42.42.2(pid=25276): stdout: | (launched: 2022-12-09_16:59:40.948066) 16:59:43.843024 run osmo-hlr_10.42.42.2(pid=25276): stderr: | [0;m[1;31m20221209165941126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165941126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165941126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165941126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165941126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165941126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165941138 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165941148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165941148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165941148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:43.911753 run osmo-msc_10.42.42.6(pid=25282): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25282)] 16:59:43.959192 run osmo-msc_10.42.42.6(pid=25282): stdout: | (launched: 2022-12-09_16:59:42.832148) 16:59:44.008303 run osmo-msc_10.42.42.6(pid=25282): stderr: | [0;m[38;5;43m20221209165943104 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165943104 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f61910c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165943104 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165943105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165943105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165943105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165943107 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165943107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165943107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165943107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:44.057702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25275): Terminating (SIGTERM) 16:59:44.097414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25278): Terminating (SIGTERM) 16:59:44.137313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25281): Terminating (SIGTERM) 16:59:44.177216 --- ParallelTerminationStrategy: PID 25275 died... 16:59:44.196106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25275): Terminated: ok {rc=0} 16:59:44.241000 --- ParallelTerminationStrategy: PID 25278 died... 16:59:44.259574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25278): Terminated: ok {rc=0} 16:59:44.304234 --- ParallelTerminationStrategy: PID 25281 died... 16:59:44.322716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25281): Terminated: ok {rc=0} 16:59:44.408042 bus /sierra_3: Setting Powered False 16:59:45.505929 bus /sierra_3: Setting Powered False 16:59:46.616614 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 16:59:47.864820 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:47.870347 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 16:59:47.928725 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 16:59:47.955393 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 16:59:48.007537 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 16:59:48.066001 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 16:59:48.092112 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 16:59:48.650959 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 16:59:48.657216 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:48.669064 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:59:48.712913 tst handover.py: using LAC 22470 16:59:48.830741 tst handover.py: using RAC 30 16:59:48.949665 tst handover.py: using CellId 22470 16:59:49.067017 tst handover.py: using BVCI 22471 16:59:49.178688 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 16:59:49.228526 tst handover.py: using LAC 22471 16:59:49.347364 tst handover.py: using RAC 31 16:59:49.464358 tst handover.py: using CellId 22471 16:59:49.581568 tst handover.py: using BVCI 22472 16:59:49.693253 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:49.704172 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:49.715046 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:49.725950 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:49.736716 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 16:59:49.747499 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:59:49.867993 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 16:59:49.987722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:50.465786 run create_hlr_db(pid=25288): Launched 16:59:50.593263 bus /sierra_2: Setting Powered False 16:59:51.658565 run create_hlr_db(pid=25288): Terminated: ok {rc=0} 16:59:52.070346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25290): Launched 16:59:52.376812 run osmo-hlr_10.42.42.2(pid=25291): Launched 16:59:52.494069 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:53.010457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25293): Launched 16:59:53.315314 run osmo-stp_10.42.42.5(pid=25294): Launched 16:59:53.432421 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:53.956896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25296): Launched 16:59:54.262000 run osmo-msc_10.42.42.6(pid=25297): Launched 16:59:54.432035 run osmo-stp_10.42.42.5(pid=25294): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25294)] 16:59:54.560151 run osmo-stp_10.42.42.5(pid=25294): stdout: | (launched: 2022-12-09_16:59:53.259605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:54.687893 run osmo-stp_10.42.42.5(pid=25294): stderr: | [0;m[38;5;43m20221209165953431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165953431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165953431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165953432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165953432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165953433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165953433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:54.814666 run osmo-stp_10.42.42.5(pid=25294): stdout: | (launched: 2022-12-09_16:59:53.259605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:54.935542 run osmo-stp_10.42.42.5(pid=25294): stderr: | [0;m[38;5;43m20221209165953431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209165953431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209165953431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209165953432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209165953432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209165953433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209165953433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:55.079682 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25294): Process ended prematurely: osmo-stp_10.42.42.5(pid=25294) [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25294)] [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 16:59:55.087899 tst handover.py:18: Test FAILED (6.4 sec) 16:59:55.113743 run osmo-hlr_10.42.42.2(pid=25291): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25291)] 16:59:55.160364 run osmo-hlr_10.42.42.2(pid=25291): stdout: | (launched: 2022-12-09_16:59:52.320340) 16:59:55.208714 run osmo-hlr_10.42.42.2(pid=25291): stderr: | [0;m[1;31m20221209165952498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209165952498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209165952498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209165952498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209165952498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209165952498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209165952510 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209165952519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209165952519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209165952519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:55.276287 run osmo-msc_10.42.42.6(pid=25297): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25297)] 16:59:55.323186 run osmo-msc_10.42.42.6(pid=25297): stdout: | (launched: 2022-12-09_16:59:54.206191) 16:59:55.371250 run osmo-msc_10.42.42.6(pid=25297): stderr: | [0;m[38;5;43m20221209165954476 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209165954476 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f59f1b2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209165954476 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209165954476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209165954476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209165954476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209165954478 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209165954479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209165954479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209165954479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:55.419673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25290): Terminating (SIGTERM) 16:59:55.458577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25293): Terminating (SIGTERM) 16:59:55.497549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25296): Terminating (SIGTERM) 16:59:55.536799 --- ParallelTerminationStrategy: PID 25290 died... 16:59:55.555515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25290): Terminated: ok {rc=0} 16:59:55.598888 --- ParallelTerminationStrategy: PID 25293 died... 16:59:55.617209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25293): Terminated: ok {rc=0} 16:59:55.660102 --- ParallelTerminationStrategy: PID 25296 died... 16:59:55.678455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25296): Terminated: ok {rc=0} 16:59:55.760327 bus /sierra_3: Setting Powered False 16:59:56.854684 bus /sierra_3: Setting Powered False 16:59:57.965743 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 16:59:59.236538 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:59.242460 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 16:59:59.302796 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:59:59.330694 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 16:59:59.387129 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 16:59:59.447668 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:59:59.475469 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:00:00.025325 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 17:00:00.030790 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:00.042503 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:00:00.091569 tst handover.py: using LAC 22472 17:00:00.218984 tst handover.py: using RAC 32 17:00:00.347497 tst handover.py: using CellId 22472 17:00:00.477342 tst handover.py: using BVCI 22473 17:00:00.597897 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:00:00.645280 tst handover.py: using LAC 22473 17:00:00.773360 tst handover.py: using RAC 33 17:00:00.902952 tst handover.py: using CellId 22473 17:00:01.039276 tst handover.py: using BVCI 22474 17:00:01.191661 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:01.204070 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:01.216104 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:01.228242 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:01.240787 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:01.253750 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:00:01.386478 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:00:01.525352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:01.993790 run create_hlr_db(pid=25305): Launched 17:00:02.156297 bus /sierra_2: Setting Powered False 17:00:03.217982 run create_hlr_db(pid=25305): Terminated: ok {rc=0} 17:00:03.619620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25307): Launched 17:00:03.927222 run osmo-hlr_10.42.42.2(pid=25308): Launched 17:00:04.043191 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:04.541909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25310): Launched 17:00:04.848194 run osmo-stp_10.42.42.5(pid=25311): Launched 17:00:04.964137 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:05.488484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25313): Launched 17:00:05.793946 run osmo-msc_10.42.42.6(pid=25314): Launched 17:00:05.964676 run osmo-stp_10.42.42.5(pid=25311): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25311)] 17:00:06.093186 run osmo-stp_10.42.42.5(pid=25311): stdout: | (launched: 2022-12-09_17:00:04.791045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:06.222127 run osmo-stp_10.42.42.5(pid=25311): stderr: | [0;m[38;5;43m20221209170004964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209170004964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209170004965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209170004965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209170004965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209170004966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209170004966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:06.348732 run osmo-stp_10.42.42.5(pid=25311): stdout: | (launched: 2022-12-09_17:00:04.791045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:06.470108 run osmo-stp_10.42.42.5(pid=25311): stderr: | [0;m[38;5;43m20221209170004964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209170004964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209170004965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209170004965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209170004965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209170004966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209170004966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:06.615087 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25311): Process ended prematurely: osmo-stp_10.42.42.5(pid=25311) [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25311)] [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 17:00:06.623296 tst handover.py:18: Test FAILED (6.6 sec) 17:00:06.649468 run osmo-hlr_10.42.42.2(pid=25308): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25308)] 17:00:06.697064 run osmo-hlr_10.42.42.2(pid=25308): stdout: | (launched: 2022-12-09_17:00:03.871158) 17:00:06.746226 run osmo-hlr_10.42.42.2(pid=25308): stderr: | [0;m[1;31m20221209170004048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209170004048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209170004048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209170004048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209170004048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209170004048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209170004060 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209170004069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209170004069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209170004069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:06.815237 run osmo-msc_10.42.42.6(pid=25314): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25314)] 17:00:06.863503 run osmo-msc_10.42.42.6(pid=25314): stdout: | (launched: 2022-12-09_17:00:05.737936) 17:00:06.912618 run osmo-msc_10.42.42.6(pid=25314): stderr: | [0;m[38;5;43m20221209170006008 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209170006008 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6a04bc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209170006008 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209170006008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209170006008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209170006009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209170006010 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209170006011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209170006011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209170006011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:06.962089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25307): Terminating (SIGTERM) 17:00:07.001516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25310): Terminating (SIGTERM) 17:00:07.040879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25313): Terminating (SIGTERM) 17:00:07.080484 --- ParallelTerminationStrategy: PID 25307 died... 17:00:07.099571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25307): Terminated: ok {rc=0} 17:00:07.143352 --- ParallelTerminationStrategy: PID 25310 died... 17:00:07.161899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25310): Terminated: ok {rc=0} 17:00:07.205498 --- ParallelTerminationStrategy: PID 25313 died... 17:00:07.224125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25313): Terminated: ok {rc=0} 17:00:07.306706 bus /sierra_3: Setting Powered False 17:00:08.404637 bus /sierra_3: Setting Powered False 17:00:09.520847 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 17:00:10.786522 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:10.791437 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 17:00:10.842307 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 17:00:10.869354 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 17:00:10.922559 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 17:00:10.974050 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 17:00:11.000550 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 17:00:11.552937 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 17:00:11.559123 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:00:11.570451 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 17:00:11.617771 tst handover.py: using LAC 22474 17:00:11.737559 tst handover.py: using RAC 34 17:00:11.855059 tst handover.py: using CellId 22474 17:00:11.973306 tst handover.py: using BVCI 22475 17:00:12.083686 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 17:00:12.117512 tst handover.py: using LAC 22475 17:00:12.237089 tst handover.py: using RAC 35 17:00:12.354474 tst handover.py: using CellId 22475 17:00:12.472159 tst handover.py: using BVCI 22476 17:00:12.582281 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:00:12.593344 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:00:12.603932 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:00:12.614676 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:00:12.625527 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:00:12.636222 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 17:00:12.755823 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 17:00:12.876796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:13.357495 run create_hlr_db(pid=25320): Launched 17:00:13.484286 bus /sierra_2: Setting Powered False 17:00:14.549357 run create_hlr_db(pid=25320): Terminated: ok {rc=0} 17:00:14.978043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25322): Launched 17:00:15.309039 run osmo-hlr_10.42.42.2(pid=25323): Launched 17:00:15.437559 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:15.982231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25325): Launched 17:00:16.334094 run osmo-stp_10.42.42.5(pid=25326): Launched 17:00:16.598189 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:17.252098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25328): Launched 17:00:17.594279 run osmo-msc_10.42.42.6(pid=25329): Launched 17:00:17.780606 run osmo-stp_10.42.42.5(pid=25326): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25326)] 17:00:17.918773 run osmo-stp_10.42.42.5(pid=25326): stdout: | (launched: 2022-12-09_17:00:16.272283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:18.057251 run osmo-stp_10.42.42.5(pid=25326): stderr: | [0;m[38;5;43m20221209170016599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209170016600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209170016600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209170016600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209170016608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209170016609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209170016609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:18.193631 run osmo-stp_10.42.42.5(pid=25326): stdout: | (launched: 2022-12-09_17:00:16.272283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:18.324107 run osmo-stp_10.42.42.5(pid=25326): stderr: | [0;m[38;5;43m20221209170016599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209170016600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209170016600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209170016600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209170016608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209170016609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209170016609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:18.480276 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25326): Process ended prematurely: osmo-stp_10.42.42.5(pid=25326) [trial-2361↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25326)] [trial-2361↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 17:00:18.489326 tst handover.py:18: Test FAILED (6.9 sec) 17:00:18.517074 run osmo-hlr_10.42.42.2(pid=25323): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25323)] 17:00:18.566636 run osmo-hlr_10.42.42.2(pid=25323): stdout: | (launched: 2022-12-09_17:00:15.249378) 17:00:18.617756 run osmo-hlr_10.42.42.2(pid=25323): stderr: | [0;m[1;31m20221209170015447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209170015447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209170015447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209170015447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209170015447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209170015447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209170015506 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209170015515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209170015515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209170015515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:18.689374 run osmo-msc_10.42.42.6(pid=25329): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25329)] 17:00:18.739473 run osmo-msc_10.42.42.6(pid=25329): stdout: | (launched: 2022-12-09_17:00:17.534551) 17:00:18.791023 run osmo-msc_10.42.42.6(pid=25329): stderr: | [0;m[38;5;43m20221209170017855 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209170017855 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f07b3d63c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209170017856 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209170017856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209170017856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209170017856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209170017858 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209170017858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209170017858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209170017858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:18.843454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25322): Terminating (SIGTERM) 17:00:18.885391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25325): Terminating (SIGTERM) 17:00:18.927410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25328): Terminating (SIGTERM) 17:00:18.969900 --- ParallelTerminationStrategy: PID 25322 died... 17:00:18.989947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25322): Terminated: ok {rc=0} 17:00:19.036942 --- ParallelTerminationStrategy: PID 25325 died... 17:00:19.056652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25325): Terminated: ok {rc=0} 17:00:19.103256 --- ParallelTerminationStrategy: PID 25328 died... 17:00:19.122943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25328): Terminated: ok {rc=0} 17:00:19.210772 bus /sierra_3: Setting Powered False 17:00:20.309662 bus /sierra_3: Setting Powered False 17:00:21.425383 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 17:00:22.687332 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:22.693316 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:00:22.761280 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:00:22.789923 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:00:22.846958 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:00:22.913382 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:00:22.939613 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:00:23.489763 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 17:00:23.496159 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:23.508060 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:00:23.561471 tst handover.py: using LAC 22476 17:00:23.691371 tst handover.py: using RAC 36 17:00:23.820650 tst handover.py: using CellId 22476 17:00:23.949595 tst handover.py: using BVCI 22477 17:00:24.068011 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:00:24.117294 tst handover.py: using LAC 22477 17:00:24.245057 tst handover.py: using RAC 37 17:00:24.375296 tst handover.py: using CellId 22477 17:00:24.502342 tst handover.py: using BVCI 22478 17:00:24.620750 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:24.632204 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:24.643489 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:24.655009 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:24.667003 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:24.678851 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:00:24.794790 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:00:24.916283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:25.396525 run create_hlr_db(pid=25334): Launched 17:00:25.521407 bus /sierra_2: Setting Powered False 17:00:26.586027 run create_hlr_db(pid=25334): Terminated: ok {rc=0} 17:00:26.998761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25336): Launched 17:00:27.307341 run osmo-hlr_10.42.42.2(pid=25337): Launched 17:00:27.425388 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:27.926041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25339): Launched 17:00:28.230873 run osmo-stp_10.42.42.5(pid=25340): Launched 17:00:28.347487 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:28.871533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25342): Launched 17:00:29.178142 run osmo-msc_10.42.42.6(pid=25343): Launched 17:00:29.348863 run osmo-stp_10.42.42.5(pid=25340): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25340)] 17:00:29.478884 run osmo-stp_10.42.42.5(pid=25340): stdout: | (launched: 2022-12-09_17:00:28.174748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:29.606390 run osmo-stp_10.42.42.5(pid=25340): stderr: | [0;m[38;5;43m20221209170028346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209170028346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209170028347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209170028347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209170028347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209170028348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209170028348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:29.732859 run osmo-stp_10.42.42.5(pid=25340): stdout: | (launched: 2022-12-09_17:00:28.174748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:29.854119 run osmo-stp_10.42.42.5(pid=25340): stderr: | [0;m[38;5;43m20221209170028346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209170028346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209170028347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209170028347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209170028347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209170028348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209170028348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:29.999403 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25340): Process ended prematurely: osmo-stp_10.42.42.5(pid=25340) [trial-2361↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25340)] [trial-2361↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 17:00:30.007662 tst handover.py:18: Test FAILED (6.5 sec) 17:00:30.033344 run osmo-hlr_10.42.42.2(pid=25337): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25337)] 17:00:30.080158 run osmo-hlr_10.42.42.2(pid=25337): stdout: | (launched: 2022-12-09_17:00:27.251578) 17:00:30.128589 run osmo-hlr_10.42.42.2(pid=25337): stderr: | [0;m[1;31m20221209170027429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209170027429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209170027429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209170027429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209170027429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209170027429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209170027476 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209170027485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209170027486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209170027486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:30.196192 run osmo-msc_10.42.42.6(pid=25343): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25343)] 17:00:30.243380 run osmo-msc_10.42.42.6(pid=25343): stdout: | (launched: 2022-12-09_17:00:29.122177) 17:00:30.292211 run osmo-msc_10.42.42.6(pid=25343): stderr: | [0;m[38;5;43m20221209170029395 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209170029395 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe8011eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209170029395 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209170029395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209170029395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209170029396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209170029397 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209170029398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209170029398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209170029398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:30.341088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25336): Terminating (SIGTERM) 17:00:30.379842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25339): Terminating (SIGTERM) 17:00:30.418591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25342): Terminating (SIGTERM) 17:00:30.457532 --- ParallelTerminationStrategy: PID 25336 died... 17:00:30.476368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25336): Terminated: ok {rc=0} 17:00:30.519515 --- ParallelTerminationStrategy: PID 25339 died... 17:00:30.537847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25339): Terminated: ok {rc=0} 17:00:30.580712 --- ParallelTerminationStrategy: PID 25342 died... 17:00:30.598989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25342): Terminated: ok {rc=0} 17:00:30.683381 bus /sierra_3: Setting Powered False 17:00:31.779658 bus /sierra_3: Setting Powered False 17:00:32.896305 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 17:00:34.185211 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:34.190979 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:00:34.255711 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:00:34.283442 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:00:34.342347 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:00:34.407583 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:00:34.435137 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:00:34.982823 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 17:00:34.988312 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:34.999928 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:00:35.049440 tst handover.py: using LAC 22478 17:00:35.181268 tst handover.py: using RAC 38 17:00:35.307183 tst handover.py: using CellId 22478 17:00:35.434390 tst handover.py: using BVCI 22479 17:00:35.554179 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:00:35.605926 tst handover.py: using LAC 22479 17:00:35.733885 tst handover.py: using RAC 39 17:00:35.860159 tst handover.py: using CellId 22479 17:00:35.987834 tst handover.py: using BVCI 22480 17:00:36.106099 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:36.117577 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:36.128874 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:36.140530 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:36.152199 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:36.163648 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:00:36.283742 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:00:36.404078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:36.881924 run create_hlr_db(pid=25348): Launched 17:00:37.007338 bus /sierra_2: Setting Powered False 17:00:38.071369 run create_hlr_db(pid=25348): Terminated: ok {rc=0} 17:00:38.481639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25350): Launched 17:00:38.786216 run osmo-hlr_10.42.42.2(pid=25351): Launched 17:00:38.902326 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:39.401405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25353): Launched 17:00:39.707290 run osmo-stp_10.42.42.5(pid=25354): Launched 17:00:39.823024 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:40.347212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25356): Launched 17:00:40.653598 run osmo-msc_10.42.42.6(pid=25357): Launched 17:00:40.825158 run osmo-stp_10.42.42.5(pid=25354): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25354)] 17:00:40.954530 run osmo-stp_10.42.42.5(pid=25354): stdout: | (launched: 2022-12-09_17:00:39.651288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:41.083008 run osmo-stp_10.42.42.5(pid=25354): stderr: | [0;m[38;5;43m20221209170039823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209170039823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209170039823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209170039824 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209170039825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209170039825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209170039825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:41.210196 run osmo-stp_10.42.42.5(pid=25354): stdout: | (launched: 2022-12-09_17:00:39.651288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:41.331240 run osmo-stp_10.42.42.5(pid=25354): stderr: | [0;m[38;5;43m20221209170039823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209170039823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209170039823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209170039824 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209170039825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209170039825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209170039825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:41.476128 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25354): Process ended prematurely: osmo-stp_10.42.42.5(pid=25354) [trial-2361↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25354)] [trial-2361↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 17:00:41.484346 tst handover.py:18: Test FAILED (6.5 sec) 17:00:41.510219 run osmo-hlr_10.42.42.2(pid=25351): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25351)] 17:00:41.557459 run osmo-hlr_10.42.42.2(pid=25351): stdout: | (launched: 2022-12-09_17:00:38.730540) 17:00:41.606295 run osmo-hlr_10.42.42.2(pid=25351): stderr: | [0;m[1;31m20221209170038904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209170038904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209170038905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209170038905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209170038905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209170038905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209170038918 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209170038927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209170038927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209170038927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:41.674590 run osmo-msc_10.42.42.6(pid=25357): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25357)] 17:00:41.721608 run osmo-msc_10.42.42.6(pid=25357): stdout: | (launched: 2022-12-09_17:00:40.597521) 17:00:41.770226 run osmo-msc_10.42.42.6(pid=25357): stderr: | [0;m[38;5;43m20221209170040868 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209170040868 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbaccbffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209170040868 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209170040868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209170040869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209170040869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209170040870 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209170040871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209170040871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209170040871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:41.819370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25350): Terminating (SIGTERM) 17:00:41.858415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25353): Terminating (SIGTERM) 17:00:41.897392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25356): Terminating (SIGTERM) 17:00:41.937262 --- ParallelTerminationStrategy: PID 25350 died... 17:00:41.956086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25350): Terminated: ok {rc=0} 17:00:42.000036 --- ParallelTerminationStrategy: PID 25353 died... 17:00:42.018383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25353): Terminated: ok {rc=0} 17:00:42.061375 --- ParallelTerminationStrategy: PID 25356 died... 17:00:42.079872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25356): Terminated: ok {rc=0} 17:00:42.164074 bus /sierra_3: Setting Powered False 17:00:43.262369 bus /sierra_3: Setting Powered False 17:00:44.376203 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 17:00:45.657373 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:45.663220 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:00:45.716728 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:00:45.744755 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:00:45.797482 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:00:45.854170 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:00:45.890383 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:00:46.429463 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 17:00:46.438351 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:46.453711 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:00:46.498691 tst handover.py: using LAC 22480 17:00:46.662442 tst handover.py: using RAC 40 17:00:46.791314 tst handover.py: using CellId 22480 17:00:46.921618 tst handover.py: using BVCI 22481 17:00:47.037390 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:00:47.085503 tst handover.py: using LAC 22481 17:00:47.213290 tst handover.py: using RAC 41 17:00:47.334546 tst handover.py: using CellId 22481 17:00:47.453429 tst handover.py: using BVCI 22482 17:00:47.566484 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:47.577579 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:47.588348 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:47.599664 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:47.611112 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:00:47.622590 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:00:47.744883 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:00:47.864693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:48.342160 run create_hlr_db(pid=25362): Launched 17:00:48.469271 bus /sierra_2: Setting Powered False 17:00:49.534151 run create_hlr_db(pid=25362): Terminated: ok {rc=0} 17:00:49.945728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25364): Launched 17:00:50.251625 run osmo-hlr_10.42.42.2(pid=25365): Launched 17:00:50.368718 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:50.867978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25367): Launched 17:00:51.173745 run osmo-stp_10.42.42.5(pid=25368): Launched 17:00:51.290659 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:51.815853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25370): Launched 17:00:52.123299 run osmo-msc_10.42.42.6(pid=25371): Launched 17:00:52.295063 run osmo-stp_10.42.42.5(pid=25368): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25368)] 17:00:52.423790 run osmo-stp_10.42.42.5(pid=25368): stdout: | (launched: 2022-12-09_17:00:51.118084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:52.551917 run osmo-stp_10.42.42.5(pid=25368): stderr: | [0;m[38;5;43m20221209170051289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209170051290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209170051290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209170051290 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209170051291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209170051291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209170051291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:52.678792 run osmo-stp_10.42.42.5(pid=25368): stdout: | (launched: 2022-12-09_17:00:51.118084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:52.800584 run osmo-stp_10.42.42.5(pid=25368): stderr: | [0;m[38;5;43m20221209170051289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209170051290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209170051290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209170051290 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209170051291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209170051291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209170051291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:52.946375 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25368): Process ended prematurely: osmo-stp_10.42.42.5(pid=25368) [trial-2361↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25368)] [trial-2361↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 17:00:52.954652 tst handover.py:18: Test FAILED (6.5 sec) 17:00:52.980660 run osmo-hlr_10.42.42.2(pid=25365): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25365)] 17:00:53.028073 run osmo-hlr_10.42.42.2(pid=25365): stdout: | (launched: 2022-12-09_17:00:50.195510) 17:00:53.077098 run osmo-hlr_10.42.42.2(pid=25365): stderr: | [0;m[1;31m20221209170050369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209170050370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209170050370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209170050370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209170050370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209170050370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209170050384 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209170050393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209170050393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209170050393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:53.145635 run osmo-msc_10.42.42.6(pid=25371): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25371)] 17:00:53.193305 run osmo-msc_10.42.42.6(pid=25371): stdout: | (launched: 2022-12-09_17:00:52.066973) 17:00:53.242668 run osmo-msc_10.42.42.6(pid=25371): stderr: | [0;m[38;5;43m20221209170052337 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209170052337 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbaf27e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209170052337 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209170052337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209170052338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209170052338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209170052339 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209170052340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209170052340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209170052340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:53.291971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25364): Terminating (SIGTERM) 17:00:53.331252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25367): Terminating (SIGTERM) 17:00:53.370670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25370): Terminating (SIGTERM) 17:00:53.410567 --- ParallelTerminationStrategy: PID 25364 died... 17:00:53.429680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25364): Terminated: ok {rc=0} 17:00:53.473266 --- ParallelTerminationStrategy: PID 25367 died... 17:00:53.491945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25367): Terminated: ok {rc=0} 17:00:53.535310 --- ParallelTerminationStrategy: PID 25370 died... 17:00:53.553947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25370): Terminated: ok {rc=0} 17:00:53.636447 bus /sierra_3: Setting Powered False 17:00:54.733200 bus /sierra_3: Setting Powered False 17:00:55.849512 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 17:00:57.105593 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:57.111345 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:00:57.163965 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:00:57.190556 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:00:57.244195 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:00:57.296580 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:00:57.324748 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:00:57.868802 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 17:00:57.875442 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:57.888741 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:00:57.926541 tst handover.py: using LAC 22482 17:00:58.056439 tst handover.py: using RAC 42 17:00:58.184791 tst handover.py: using CellId 22482 17:00:58.312524 tst handover.py: using BVCI 22483 17:00:58.431370 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:00:58.484719 tst handover.py: using LAC 22483 17:00:58.612448 tst handover.py: using RAC 43 17:00:58.738496 tst handover.py: using CellId 22483 17:00:58.864193 tst handover.py: using BVCI 22484 17:00:58.982832 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:58.994300 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:59.005626 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:59.017143 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:59.028596 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:00:59.040122 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:00:59.156474 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:00:59.275572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:59.756277 run create_hlr_db(pid=25376): Launched 17:00:59.882722 bus /sierra_2: Setting Powered False 17:01:00.951026 run create_hlr_db(pid=25376): Terminated: ok {rc=0} 17:01:01.384102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25378): Launched 17:01:01.721279 run osmo-hlr_10.42.42.2(pid=25379): Launched 17:01:01.910035 run osmo-stp_10.42.42.5: Starting osmo-stp 17:01:02.642543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25381): Launched 17:01:02.971483 run osmo-stp_10.42.42.5(pid=25382): Launched 17:01:03.097759 run osmo-msc_10.42.42.6: Starting osmo-msc 17:01:03.662627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25384): Launched 17:01:03.992343 run osmo-msc_10.42.42.6(pid=25385): Launched 17:01:04.175982 run osmo-stp_10.42.42.5(pid=25382): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25382)] 17:01:04.315352 run osmo-stp_10.42.42.5(pid=25382): stdout: | (launched: 2022-12-09_17:01:02.911693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:04.454991 run osmo-stp_10.42.42.5(pid=25382): stderr: | [0;m[38;5;43m20221209170103103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209170103104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209170103104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209170103104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209170103105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209170103105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209170103105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:04.592082 run osmo-stp_10.42.42.5(pid=25382): stdout: | (launched: 2022-12-09_17:01:02.911693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:04.723781 run osmo-stp_10.42.42.5(pid=25382): stderr: | [0;m[38;5;43m20221209170103103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209170103104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209170103104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209170103104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209170103105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209170103105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209170103105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:04.880650 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25382): Process ended prematurely: osmo-stp_10.42.42.5(pid=25382) [trial-2361↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25382)] [trial-2361↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 17:01:04.889857 tst handover.py:18: Test FAILED (7.0 sec) 17:01:04.918013 run osmo-hlr_10.42.42.2(pid=25379): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25379)] 17:01:04.968469 run osmo-hlr_10.42.42.2(pid=25379): stdout: | (launched: 2022-12-09_17:01:01.656905) 17:01:05.020450 run osmo-hlr_10.42.42.2(pid=25379): stderr: | [0;m[1;31m20221209170101957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209170101957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209170101957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209170101957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209170101957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209170101957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209170101972 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209170101993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209170101994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209170101995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:01:05.092809 run osmo-msc_10.42.42.6(pid=25385): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25385)] 17:01:05.142998 run osmo-msc_10.42.42.6(pid=25385): stdout: | (launched: 2022-12-09_17:01:03.932002) 17:01:05.194734 run osmo-msc_10.42.42.6(pid=25385): stderr: | [0;m[38;5;43m20221209170104252 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209170104252 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb0d66f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209170104252 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209170104252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209170104253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209170104253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209170104254 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209170104255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209170104255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209170104255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:01:05.247451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25378): Terminating (SIGTERM) 17:01:05.289526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25381): Terminating (SIGTERM) 17:01:05.331810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25384): Terminating (SIGTERM) 17:01:05.374075 --- ParallelTerminationStrategy: PID 25378 died... 17:01:05.394095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25378): Terminated: ok {rc=0} 17:01:05.441167 --- ParallelTerminationStrategy: PID 25381 died... 17:01:05.460769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25381): Terminated: ok {rc=0} 17:01:05.507528 --- ParallelTerminationStrategy: PID 25384 died... 17:01:05.527293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25384): Terminated: ok {rc=0} 17:01:05.615623 bus /sierra_3: Setting Powered False 17:01:06.715258 bus /sierra_3: Setting Powered False 17:01:07.830815 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2361 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 17:01:09.087118 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:01:09.092882 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:01:09.157512 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:01:09.185699 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:01:09.239450 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:01:09.303315 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:01:09.330795 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:01:09.882762 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2361 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 17:01:09.888476 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:01:09.900025 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:01:09.948710 tst handover.py: using LAC 22484 17:01:10.078272 tst handover.py: using RAC 44 17:01:10.207873 tst handover.py: using CellId 22484 17:01:10.339564 tst handover.py: using BVCI 22485 17:01:10.459724 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:01:10.506679 tst handover.py: using LAC 22485 17:01:10.637411 tst handover.py: using RAC 45 17:01:10.757073 tst handover.py: using CellId 22485 17:01:10.876048 tst handover.py: using BVCI 22486 17:01:10.986562 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:01:10.997493 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:01:11.008385 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:01:11.019386 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:01:11.030820 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:01:11.041679 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:01:11.162381 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:01:11.285777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:01:11.766241 run create_hlr_db(pid=25390): Launched 17:01:11.895108 bus /sierra_2: Setting Powered False 17:01:12.959825 run create_hlr_db(pid=25390): Terminated: ok {rc=0} 17:01:13.372202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25392): Launched 17:01:13.678636 run osmo-hlr_10.42.42.2(pid=25393): Launched 17:01:13.795324 run osmo-stp_10.42.42.5: Starting osmo-stp 17:01:14.307850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25395): Launched 17:01:14.614319 run osmo-stp_10.42.42.5(pid=25396): Launched 17:01:14.733268 run osmo-msc_10.42.42.6: Starting osmo-msc 17:01:15.258703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25398): Launched 17:01:15.567889 run osmo-msc_10.42.42.6(pid=25399): Launched 17:01:15.739167 run osmo-stp_10.42.42.5(pid=25396): ERR: Terminated: ERROR {rc=1} [trial-2361↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25396)] 17:01:15.943002 run osmo-stp_10.42.42.5(pid=25396): stdout: | (launched: 2022-12-09_17:01:14.558139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:16.073342 run osmo-stp_10.42.42.5(pid=25396): stderr: | [0;m[38;5;43m20221209170114730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209170114730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209170114730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209170114730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209170114731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209170114731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209170114731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:16.216499 run osmo-stp_10.42.42.5(pid=25396): stdout: | (launched: 2022-12-09_17:01:14.558139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:16.353240 run osmo-stp_10.42.42.5(pid=25396): stderr: | [0;m[38;5;43m20221209170114730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209170114730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209170114730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209170114730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209170114731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209170114731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209170114731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:16.516246 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25396): Process ended prematurely: osmo-stp_10.42.42.5(pid=25396) [trial-2361↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25396)] [trial-2361↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 17:01:16.526634 tst handover.py:18: Test FAILED (6.6 sec) 17:01:16.558549 run osmo-hlr_10.42.42.2(pid=25393): ERR: Terminated: ERROR {rc=237} [trial-2361↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25393)] 17:01:16.613008 run osmo-hlr_10.42.42.2(pid=25393): stdout: | (launched: 2022-12-09_17:01:13.622082) 17:01:16.667960 run osmo-hlr_10.42.42.2(pid=25393): stderr: | [0;m[1;31m20221209170113798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209170113798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209170113798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209170113798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209170113798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209170113798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209170113810 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209170113821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209170113821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209170113821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:01:16.743468 run osmo-msc_10.42.42.6(pid=25399): ERR: Terminated: ERROR {rc=2} [trial-2361↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25399)] 17:01:16.797681 run osmo-msc_10.42.42.6(pid=25399): stdout: | (launched: 2022-12-09_17:01:15.511397) 17:01:16.852091 run osmo-msc_10.42.42.6(pid=25399): stderr: | [0;m[38;5;43m20221209170115788 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209170115789 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc233b90c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209170115789 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209170115789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209170115789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209170115789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209170115791 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209170115791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209170115791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209170115792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:01:16.907677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25392): Terminating (SIGTERM) 17:01:16.952777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25395): Terminating (SIGTERM) 17:01:17.000211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25398): Terminating (SIGTERM) 17:01:17.047272 --- ParallelTerminationStrategy: PID 25392 died... 17:01:17.068197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25392): Terminated: ok {rc=0} 17:01:17.119312 --- ParallelTerminationStrategy: PID 25395 died... 17:01:17.139878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25395): Terminated: ok {rc=0} 17:01:17.189740 --- ParallelTerminationStrategy: PID 25398 died... 17:01:17.209433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25398): Terminated: ok {rc=0} 17:01:17.298934 bus /sierra_3: Setting Powered False 17:01:18.398019 bus /sierra_3: Setting Powered False 17:01:19.513613 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2361 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 17:01:20.776179 tst trial-2361: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/trial-2361.xml -------------------------------------------------------------------------------------------- trial-2361 FAIL -------------------------------------------------------------------------------------------- 17:01:22.702207 tst trial-2361: trial-2361: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.9 sec) Error: osmo-nitb_10.42.42.2(pid=18286): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18286) [trial-2361↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18286)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (13.6 sec) Error: osmo-stp_10.42.42.5(pid=18298): Process ended prematurely: osmo-stp_10.42.42.5(pid=18298) [trial-2361↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18298)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=18311): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18311) [trial-2361↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18311)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=18321): Process ended prematurely: osmo-stp_10.42.42.5(pid=18321) [trial-2361↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18321)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18335): Process ended prematurely: osmo-stp_10.42.42.5(pid=18335) [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18335)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18346): Process ended prematurely: osmo-stp_10.42.42.5(pid=18346) [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18346)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18363): Process ended prematurely: osmo-stp_10.42.42.5(pid=18363) [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18363)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18374): Process ended prematurely: osmo-stp_10.42.42.5(pid=18374) [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18374)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18388): Process ended prematurely: osmo-stp_10.42.42.5(pid=18388) [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18388)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18399): Process ended prematurely: osmo-stp_10.42.42.5(pid=18399) [trial-2361↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18399)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18413): Process ended prematurely: osmo-stp_10.42.42.5(pid=18413) [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18413)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18424): Process ended prematurely: osmo-stp_10.42.42.5(pid=18424) [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18424)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18438): Process ended prematurely: osmo-stp_10.42.42.5(pid=18438) [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18438)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=18449): Process ended prematurely: osmo-stp_10.42.42.5(pid=18449) [trial-2361↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18449)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18463): Process ended prematurely: osmo-stp_10.42.42.5(pid=18463) [trial-2361↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18463)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18474): Process ended prematurely: osmo-stp_10.42.42.5(pid=18474) [trial-2361↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18474)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18489): Process ended prematurely: osmo-stp_10.42.42.5(pid=18489) [trial-2361↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18489)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18507): Process ended prematurely: osmo-stp_10.42.42.5(pid=18507) [trial-2361↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18507)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18521): Process ended prematurely: osmo-stp_10.42.42.5(pid=18521) [trial-2361↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18521)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18532): Process ended prematurely: osmo-stp_10.42.42.5(pid=18532) [trial-2361↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18532)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.4 sec) Error: osmo-stp_10.42.42.5(pid=18550): Process ended prematurely: osmo-stp_10.42.42.5(pid=18550) [trial-2361↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18550)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=18562): Process ended prematurely: osmo-stp_10.42.42.5(pid=18562) [trial-2361↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18562)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=18580): Process ended prematurely: osmo-stp_10.42.42.5(pid=18580) [trial-2361↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18580)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18591): Process ended prematurely: osmo-stp_10.42.42.5(pid=18591) [trial-2361↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18591)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18601): Process ended prematurely: osmo-stp_10.42.42.5(pid=18601) [trial-2361↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18601)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=18618): Process ended prematurely: osmo-stp_10.42.42.5(pid=18618) [trial-2361↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18618)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=18631): Process ended prematurely: osmo-stp_10.42.42.5(pid=18631) [trial-2361↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18631)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=18649): Process ended prematurely: osmo-stp_10.42.42.5(pid=18649) [trial-2361↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18649)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18659): Process ended prematurely: osmo-stp_10.42.42.5(pid=18659) [trial-2361↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18659)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18669): Process ended prematurely: osmo-stp_10.42.42.5(pid=18669) [trial-2361↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18669)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=18686): Process ended prematurely: osmo-stp_10.42.42.5(pid=18686) [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18686)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=18698): Process ended prematurely: osmo-stp_10.42.42.5(pid=18698) [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18698)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=18719): Process ended prematurely: osmo-stp_10.42.42.5(pid=18719) [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18719)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18729): Process ended prematurely: osmo-stp_10.42.42.5(pid=18729) [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18729)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18740): Process ended prematurely: osmo-stp_10.42.42.5(pid=18740) [trial-2361↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18740)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=18758): Process ended prematurely: osmo-stp_10.42.42.5(pid=18758) [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18758)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=18770): Process ended prematurely: osmo-stp_10.42.42.5(pid=18770) [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18770)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=18788): Process ended prematurely: osmo-stp_10.42.42.5(pid=18788) [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18788)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18798): Process ended prematurely: osmo-stp_10.42.42.5(pid=18798) [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18798)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18808): Process ended prematurely: osmo-stp_10.42.42.5(pid=18808) [trial-2361↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18808)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18822): Process ended prematurely: osmo-stp_10.42.42.5(pid=18822) [trial-2361↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18822)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18835): Process ended prematurely: osmo-stp_10.42.42.5(pid=18835) [trial-2361↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18835)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=18843): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18843) [trial-2361↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18843)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18853): Process ended prematurely: osmo-stp_10.42.42.5(pid=18853) [trial-2361↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18853)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=18863): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18863) [trial-2361↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18863)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18873): Process ended prematurely: osmo-stp_10.42.42.5(pid=18873) [trial-2361↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18873)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18888): Process ended prematurely: osmo-stp_10.42.42.5(pid=18888) [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18888)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18899): Process ended prematurely: osmo-stp_10.42.42.5(pid=18899) [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18899)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18913): Process ended prematurely: osmo-stp_10.42.42.5(pid=18913) [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18913)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18924): Process ended prematurely: osmo-stp_10.42.42.5(pid=18924) [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18924)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18938): Process ended prematurely: osmo-stp_10.42.42.5(pid=18938) [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18938)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18949): Process ended prematurely: osmo-stp_10.42.42.5(pid=18949) [trial-2361↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18949)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18963): Process ended prematurely: osmo-stp_10.42.42.5(pid=18963) [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18963)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18974): Process ended prematurely: osmo-stp_10.42.42.5(pid=18974) [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18974)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18988): Process ended prematurely: osmo-stp_10.42.42.5(pid=18988) [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18988)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19000): Process ended prematurely: osmo-stp_10.42.42.5(pid=19000) [trial-2361↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19000)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=19014): Process ended prematurely: osmo-stp_10.42.42.5(pid=19014) [trial-2361↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19014)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19025): Process ended prematurely: osmo-stp_10.42.42.5(pid=19025) [trial-2361↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19025)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19039): Process ended prematurely: osmo-stp_10.42.42.5(pid=19039) [trial-2361↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19039)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19050): Process ended prematurely: osmo-stp_10.42.42.5(pid=19050) [trial-2361↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19050)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19067): Process ended prematurely: osmo-stp_10.42.42.5(pid=19067) [trial-2361↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19067)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19078): Process ended prematurely: osmo-stp_10.42.42.5(pid=19078) [trial-2361↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19078)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=19097): Process ended prematurely: osmo-stp_10.42.42.5(pid=19097) [trial-2361↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19097)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=19109): Process ended prematurely: osmo-stp_10.42.42.5(pid=19109) [trial-2361↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19109)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=19127): Process ended prematurely: osmo-stp_10.42.42.5(pid=19127) [trial-2361↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19127)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19137): Process ended prematurely: osmo-stp_10.42.42.5(pid=19137) [trial-2361↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19137)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19147): Process ended prematurely: osmo-stp_10.42.42.5(pid=19147) [trial-2361↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19147)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=19165): Process ended prematurely: osmo-stp_10.42.42.5(pid=19165) [trial-2361↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19165)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=19177): Process ended prematurely: osmo-stp_10.42.42.5(pid=19177) [trial-2361↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19177)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=19195): Process ended prematurely: osmo-stp_10.42.42.5(pid=19195) [trial-2361↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19195)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19205): Process ended prematurely: osmo-stp_10.42.42.5(pid=19205) [trial-2361↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19205)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19215): Process ended prematurely: osmo-stp_10.42.42.5(pid=19215) [trial-2361↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19215)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=19235): Process ended prematurely: osmo-stp_10.42.42.5(pid=19235) [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19235)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=19247): Process ended prematurely: osmo-stp_10.42.42.5(pid=19247) [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19247)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=19265): Process ended prematurely: osmo-stp_10.42.42.5(pid=19265) [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19265)] FAIL: ping.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=19546): Process ended prematurely: osmo-stp_10.42.42.5(pid=19546) [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19546)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19558): Process ended prematurely: osmo-stp_10.42.42.5(pid=19558) [trial-2361↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19558)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=19575): Process ended prematurely: osmo-stp_10.42.42.5(pid=19575) [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19575)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=19587): Process ended prematurely: osmo-stp_10.42.42.5(pid=19587) [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19587)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=19605): Process ended prematurely: osmo-stp_10.42.42.5(pid=19605) [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19605)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19615): Process ended prematurely: osmo-stp_10.42.42.5(pid=19615) [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19615)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19627): Process ended prematurely: osmo-stp_10.42.42.5(pid=19627) [trial-2361↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19627)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19640): Process ended prematurely: osmo-stp_10.42.42.5(pid=19640) [trial-2361↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19640)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19653): Process ended prematurely: osmo-stp_10.42.42.5(pid=19653) [trial-2361↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19653)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=19661): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19661) [trial-2361↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19661)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19675): Process ended prematurely: osmo-stp_10.42.42.5(pid=19675) [trial-2361↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19675)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=19684): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19684) [trial-2361↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19684)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=19694): Process ended prematurely: osmo-stp_10.42.42.5(pid=19694) [trial-2361↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19694)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19708): Process ended prematurely: osmo-stp_10.42.42.5(pid=19708) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19708)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19719): Process ended prematurely: osmo-stp_10.42.42.5(pid=19719) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19719)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19733): Process ended prematurely: osmo-stp_10.42.42.5(pid=19733) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19733)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19750): Process ended prematurely: osmo-stp_10.42.42.5(pid=19750) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19750)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19764): Process ended prematurely: osmo-stp_10.42.42.5(pid=19764) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19764)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19778): Process ended prematurely: osmo-stp_10.42.42.5(pid=19778) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19778)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19792): Process ended prematurely: osmo-stp_10.42.42.5(pid=19792) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19792)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19803): Process ended prematurely: osmo-stp_10.42.42.5(pid=19803) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19803)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19817): Process ended prematurely: osmo-stp_10.42.42.5(pid=19817) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19817)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19828): Process ended prematurely: osmo-stp_10.42.42.5(pid=19828) [trial-2361↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19828)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19842): Process ended prematurely: osmo-stp_10.42.42.5(pid=19842) [trial-2361↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19842)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19853): Process ended prematurely: osmo-stp_10.42.42.5(pid=19853) [trial-2361↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19853)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19867): Process ended prematurely: osmo-stp_10.42.42.5(pid=19867) [trial-2361↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19867)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19878): Process ended prematurely: osmo-stp_10.42.42.5(pid=19878) [trial-2361↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19878)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19892): Process ended prematurely: osmo-stp_10.42.42.5(pid=19892) [trial-2361↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19892)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19903): Process ended prematurely: osmo-stp_10.42.42.5(pid=19903) [trial-2361↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19903)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19917): Process ended prematurely: osmo-stp_10.42.42.5(pid=19917) [trial-2361↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19917)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19928): Process ended prematurely: osmo-stp_10.42.42.5(pid=19928) [trial-2361↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19928)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19943): Process ended prematurely: osmo-stp_10.42.42.5(pid=19943) [trial-2361↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19943)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19954): Process ended prematurely: osmo-stp_10.42.42.5(pid=19954) [trial-2361↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19954)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=19974): Process ended prematurely: osmo-stp_10.42.42.5(pid=19974) [trial-2361↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19974)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=19986): Process ended prematurely: osmo-stp_10.42.42.5(pid=19986) [trial-2361↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19986)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=20005): Process ended prematurely: osmo-stp_10.42.42.5(pid=20005) [trial-2361↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20005)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20015): Process ended prematurely: osmo-stp_10.42.42.5(pid=20015) [trial-2361↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20015)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20028): Process ended prematurely: osmo-stp_10.42.42.5(pid=20028) [trial-2361↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20028)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=20047): Process ended prematurely: osmo-stp_10.42.42.5(pid=20047) [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20047)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=20059): Process ended prematurely: osmo-stp_10.42.42.5(pid=20059) [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20059)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=20077): Process ended prematurely: osmo-stp_10.42.42.5(pid=20077) [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20077)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20087): Process ended prematurely: osmo-stp_10.42.42.5(pid=20087) [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20087)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20097): Process ended prematurely: osmo-stp_10.42.42.5(pid=20097) [trial-2361↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20097)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=20115): Process ended prematurely: osmo-stp_10.42.42.5(pid=20115) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20115)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20127): Process ended prematurely: osmo-stp_10.42.42.5(pid=20127) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20127)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=20145): Process ended prematurely: osmo-stp_10.42.42.5(pid=20145) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20145)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20155): Process ended prematurely: osmo-stp_10.42.42.5(pid=20155) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20155)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20165): Process ended prematurely: osmo-stp_10.42.42.5(pid=20165) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20165)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=20183): Process ended prematurely: osmo-stp_10.42.42.5(pid=20183) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20183)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20195): Process ended prematurely: osmo-stp_10.42.42.5(pid=20195) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20195)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=20215): Process ended prematurely: osmo-stp_10.42.42.5(pid=20215) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20215)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20225): Process ended prematurely: osmo-stp_10.42.42.5(pid=20225) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20225)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20236): Process ended prematurely: osmo-stp_10.42.42.5(pid=20236) [trial-2361↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20236)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.4 sec) Error: osmo-stp_10.42.42.5(pid=20253): Process ended prematurely: osmo-stp_10.42.42.5(pid=20253) [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20253)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20265): Process ended prematurely: osmo-stp_10.42.42.5(pid=20265) [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20265)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=20283): Process ended prematurely: osmo-stp_10.42.42.5(pid=20283) [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20283)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20293): Process ended prematurely: osmo-stp_10.42.42.5(pid=20293) [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20293)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20303): Process ended prematurely: osmo-stp_10.42.42.5(pid=20303) [trial-2361↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20303)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=20316): Process ended prematurely: osmo-stp_10.42.42.5(pid=20316) [trial-2361↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20316)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20330): Process ended prematurely: osmo-stp_10.42.42.5(pid=20330) [trial-2361↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20330)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=20338): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20338) [trial-2361↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20338)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20349): Process ended prematurely: osmo-stp_10.42.42.5(pid=20349) [trial-2361↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20349)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=20359): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20359) [trial-2361↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20359)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20372): Process ended prematurely: osmo-stp_10.42.42.5(pid=20372) [trial-2361↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20372)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20386): Process ended prematurely: osmo-stp_10.42.42.5(pid=20386) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20386)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20397): Process ended prematurely: osmo-stp_10.42.42.5(pid=20397) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20397)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20413): Process ended prematurely: osmo-stp_10.42.42.5(pid=20413) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20413)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20424): Process ended prematurely: osmo-stp_10.42.42.5(pid=20424) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20424)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20438): Process ended prematurely: osmo-stp_10.42.42.5(pid=20438) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20438)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20450): Process ended prematurely: osmo-stp_10.42.42.5(pid=20450) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20450)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20464): Process ended prematurely: osmo-stp_10.42.42.5(pid=20464) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20464)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20475): Process ended prematurely: osmo-stp_10.42.42.5(pid=20475) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20475)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20489): Process ended prematurely: osmo-stp_10.42.42.5(pid=20489) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20489)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20500): Process ended prematurely: osmo-stp_10.42.42.5(pid=20500) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20500)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20514): Process ended prematurely: osmo-stp_10.42.42.5(pid=20514) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20514)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20526): Process ended prematurely: osmo-stp_10.42.42.5(pid=20526) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20526)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20540): Process ended prematurely: osmo-stp_10.42.42.5(pid=20540) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20540)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20551): Process ended prematurely: osmo-stp_10.42.42.5(pid=20551) [trial-2361↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20551)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20566): Process ended prematurely: osmo-stp_10.42.42.5(pid=20566) [trial-2361↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20566)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20577): Process ended prematurely: osmo-stp_10.42.42.5(pid=20577) [trial-2361↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20577)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=20867): Process ended prematurely: osmo-stp_10.42.42.5(pid=20867) [trial-2361↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20867)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=20879): Process ended prematurely: osmo-stp_10.42.42.5(pid=20879) [trial-2361↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20879)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=20897): Process ended prematurely: osmo-stp_10.42.42.5(pid=20897) [trial-2361↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20897)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20908): Process ended prematurely: osmo-stp_10.42.42.5(pid=20908) [trial-2361↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20908)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=20918): Process ended prematurely: osmo-stp_10.42.42.5(pid=20918) [trial-2361↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20918)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=20935): Process ended prematurely: osmo-stp_10.42.42.5(pid=20935) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20935)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=20947): Process ended prematurely: osmo-stp_10.42.42.5(pid=20947) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20947)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=20965): Process ended prematurely: osmo-stp_10.42.42.5(pid=20965) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20965)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20975): Process ended prematurely: osmo-stp_10.42.42.5(pid=20975) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20975)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20989): Process ended prematurely: osmo-stp_10.42.42.5(pid=20989) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20989)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21007): Process ended prematurely: osmo-stp_10.42.42.5(pid=21007) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21007)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21019): Process ended prematurely: osmo-stp_10.42.42.5(pid=21019) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21019)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=21037): Process ended prematurely: osmo-stp_10.42.42.5(pid=21037) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21037)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21047): Process ended prematurely: osmo-stp_10.42.42.5(pid=21047) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21047)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21057): Process ended prematurely: osmo-stp_10.42.42.5(pid=21057) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21057)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21076): Process ended prematurely: osmo-stp_10.42.42.5(pid=21076) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21076)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=21088): Process ended prematurely: osmo-stp_10.42.42.5(pid=21088) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21088)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=21107): Process ended prematurely: osmo-stp_10.42.42.5(pid=21107) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21107)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21117): Process ended prematurely: osmo-stp_10.42.42.5(pid=21117) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21117)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21127): Process ended prematurely: osmo-stp_10.42.42.5(pid=21127) [trial-2361↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21127)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21140): Process ended prematurely: osmo-stp_10.42.42.5(pid=21140) [trial-2361↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21140)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21153): Process ended prematurely: osmo-stp_10.42.42.5(pid=21153) [trial-2361↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21153)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=21162): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21162) [trial-2361↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21162)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21174): Process ended prematurely: osmo-stp_10.42.42.5(pid=21174) [trial-2361↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21174)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=21183): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21183) [trial-2361↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21183)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21193): Process ended prematurely: osmo-stp_10.42.42.5(pid=21193) [trial-2361↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21193)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21207): Process ended prematurely: osmo-stp_10.42.42.5(pid=21207) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21207)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21218): Process ended prematurely: osmo-stp_10.42.42.5(pid=21218) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21218)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21233): Process ended prematurely: osmo-stp_10.42.42.5(pid=21233) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21233)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21244): Process ended prematurely: osmo-stp_10.42.42.5(pid=21244) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21244)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21258): Process ended prematurely: osmo-stp_10.42.42.5(pid=21258) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21258)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21269): Process ended prematurely: osmo-stp_10.42.42.5(pid=21269) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21269)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21283): Process ended prematurely: osmo-stp_10.42.42.5(pid=21283) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21283)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21294): Process ended prematurely: osmo-stp_10.42.42.5(pid=21294) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21294)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21310): Process ended prematurely: osmo-stp_10.42.42.5(pid=21310) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21310)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21321): Process ended prematurely: osmo-stp_10.42.42.5(pid=21321) [trial-2361↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21321)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21335): Process ended prematurely: osmo-stp_10.42.42.5(pid=21335) [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21335)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21350): Process ended prematurely: osmo-stp_10.42.42.5(pid=21350) [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21350)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21364): Process ended prematurely: osmo-stp_10.42.42.5(pid=21364) [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21364)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21375): Process ended prematurely: osmo-stp_10.42.42.5(pid=21375) [trial-2361↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21375)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21391): Process ended prematurely: osmo-stp_10.42.42.5(pid=21391) [trial-2361↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21391)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21402): Process ended prematurely: osmo-stp_10.42.42.5(pid=21402) [trial-2361↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21402)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21416): Process ended prematurely: osmo-stp_10.42.42.5(pid=21416) [trial-2361↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21416)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21427): Process ended prematurely: osmo-stp_10.42.42.5(pid=21427) [trial-2361↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21427)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=21445): Process ended prematurely: osmo-stp_10.42.42.5(pid=21445) [trial-2361↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21445)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=21457): Process ended prematurely: osmo-stp_10.42.42.5(pid=21457) [trial-2361↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21457)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=21475): Process ended prematurely: osmo-stp_10.42.42.5(pid=21475) [trial-2361↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21475)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21488): Process ended prematurely: osmo-stp_10.42.42.5(pid=21488) [trial-2361↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21488)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21498): Process ended prematurely: osmo-stp_10.42.42.5(pid=21498) [trial-2361↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21498)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=21515): Process ended prematurely: osmo-stp_10.42.42.5(pid=21515) [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21515)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=21530): Process ended prematurely: osmo-stp_10.42.42.5(pid=21530) [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21530)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=21548): Process ended prematurely: osmo-stp_10.42.42.5(pid=21548) [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21548)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21558): Process ended prematurely: osmo-stp_10.42.42.5(pid=21558) [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21558)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21568): Process ended prematurely: osmo-stp_10.42.42.5(pid=21568) [trial-2361↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21568)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=21585): Process ended prematurely: osmo-stp_10.42.42.5(pid=21585) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21585)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=21597): Process ended prematurely: osmo-stp_10.42.42.5(pid=21597) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21597)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=21615): Process ended prematurely: osmo-stp_10.42.42.5(pid=21615) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21615)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21625): Process ended prematurely: osmo-stp_10.42.42.5(pid=21625) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21625)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21635): Process ended prematurely: osmo-stp_10.42.42.5(pid=21635) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21635)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21652): Process ended prematurely: osmo-stp_10.42.42.5(pid=21652) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21652)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=21664): Process ended prematurely: osmo-stp_10.42.42.5(pid=21664) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21664)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=21683): Process ended prematurely: osmo-stp_10.42.42.5(pid=21683) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21683)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21702): Process ended prematurely: osmo-stp_10.42.42.5(pid=21702) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21702)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21713): Process ended prematurely: osmo-stp_10.42.42.5(pid=21713) [trial-2361↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21713)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21730): Process ended prematurely: osmo-stp_10.42.42.5(pid=21730) [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21730)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=21742): Process ended prematurely: osmo-stp_10.42.42.5(pid=21742) [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21742)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=21760): Process ended prematurely: osmo-stp_10.42.42.5(pid=21760) [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21760)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21770): Process ended prematurely: osmo-stp_10.42.42.5(pid=21770) [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21770)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21780): Process ended prematurely: osmo-stp_10.42.42.5(pid=21780) [trial-2361↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21780)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21793): Process ended prematurely: osmo-stp_10.42.42.5(pid=21793) [trial-2361↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21793)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21808): Process ended prematurely: osmo-stp_10.42.42.5(pid=21808) [trial-2361↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21808)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=21816): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21816) [trial-2361↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21816)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21826): Process ended prematurely: osmo-stp_10.42.42.5(pid=21826) [trial-2361↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21826)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=21835): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21835) [trial-2361↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21835)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21846): Process ended prematurely: osmo-stp_10.42.42.5(pid=21846) [trial-2361↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21846)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21860): Process ended prematurely: osmo-stp_10.42.42.5(pid=21860) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21860)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21873): Process ended prematurely: osmo-stp_10.42.42.5(pid=21873) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21873)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21887): Process ended prematurely: osmo-stp_10.42.42.5(pid=21887) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21887)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21898): Process ended prematurely: osmo-stp_10.42.42.5(pid=21898) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21898)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=22183): Process ended prematurely: osmo-stp_10.42.42.5(pid=22183) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22183)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22194): Process ended prematurely: osmo-stp_10.42.42.5(pid=22194) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22194)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22209): Process ended prematurely: osmo-stp_10.42.42.5(pid=22209) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22209)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22220): Process ended prematurely: osmo-stp_10.42.42.5(pid=22220) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22220)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22234): Process ended prematurely: osmo-stp_10.42.42.5(pid=22234) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22234)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22245): Process ended prematurely: osmo-stp_10.42.42.5(pid=22245) [trial-2361↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22245)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22260): Process ended prematurely: osmo-stp_10.42.42.5(pid=22260) [trial-2361↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22260)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22271): Process ended prematurely: osmo-stp_10.42.42.5(pid=22271) [trial-2361↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22271)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22285): Process ended prematurely: osmo-stp_10.42.42.5(pid=22285) [trial-2361↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22285)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22296): Process ended prematurely: osmo-stp_10.42.42.5(pid=22296) [trial-2361↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22296)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22311): Process ended prematurely: osmo-stp_10.42.42.5(pid=22311) [trial-2361↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22311)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22325): Process ended prematurely: osmo-stp_10.42.42.5(pid=22325) [trial-2361↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22325)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22351): Process ended prematurely: osmo-stp_10.42.42.5(pid=22351) [trial-2361↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22351)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=22363): Process ended prematurely: osmo-stp_10.42.42.5(pid=22363) [trial-2361↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22363)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=22381): Process ended prematurely: osmo-stp_10.42.42.5(pid=22381) [trial-2361↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22381)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22391): Process ended prematurely: osmo-stp_10.42.42.5(pid=22391) [trial-2361↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22391)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22401): Process ended prematurely: osmo-stp_10.42.42.5(pid=22401) [trial-2361↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22401)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=22419): Process ended prematurely: osmo-stp_10.42.42.5(pid=22419) [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22419)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=22431): Process ended prematurely: osmo-stp_10.42.42.5(pid=22431) [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22431)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=22449): Process ended prematurely: osmo-stp_10.42.42.5(pid=22449) [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22449)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22459): Process ended prematurely: osmo-stp_10.42.42.5(pid=22459) [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22459)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22469): Process ended prematurely: osmo-stp_10.42.42.5(pid=22469) [trial-2361↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22469)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=22486): Process ended prematurely: osmo-stp_10.42.42.5(pid=22486) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22486)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=22500): Process ended prematurely: osmo-stp_10.42.42.5(pid=22500) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22500)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=22518): Process ended prematurely: osmo-stp_10.42.42.5(pid=22518) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22518)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22528): Process ended prematurely: osmo-stp_10.42.42.5(pid=22528) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22528)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22539): Process ended prematurely: osmo-stp_10.42.42.5(pid=22539) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22539)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22557): Process ended prematurely: osmo-stp_10.42.42.5(pid=22557) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22557)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=22569): Process ended prematurely: osmo-stp_10.42.42.5(pid=22569) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22569)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=22587): Process ended prematurely: osmo-stp_10.42.42.5(pid=22587) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22587)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22597): Process ended prematurely: osmo-stp_10.42.42.5(pid=22597) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22597)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22607): Process ended prematurely: osmo-stp_10.42.42.5(pid=22607) [trial-2361↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22607)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22620): Process ended prematurely: osmo-stp_10.42.42.5(pid=22620) [trial-2361↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22620)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22636): Process ended prematurely: osmo-stp_10.42.42.5(pid=22636) [trial-2361↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22636)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=22644): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22644) [trial-2361↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22644)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=22654): Process ended prematurely: osmo-stp_10.42.42.5(pid=22654) [trial-2361↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22654)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=22666): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22666) [trial-2361↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22666)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22676): Process ended prematurely: osmo-stp_10.42.42.5(pid=22676) [trial-2361↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22676)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22690): Process ended prematurely: osmo-stp_10.42.42.5(pid=22690) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22690)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22701): Process ended prematurely: osmo-stp_10.42.42.5(pid=22701) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22701)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22715): Process ended prematurely: osmo-stp_10.42.42.5(pid=22715) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22715)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22726): Process ended prematurely: osmo-stp_10.42.42.5(pid=22726) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22726)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22741): Process ended prematurely: osmo-stp_10.42.42.5(pid=22741) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22741)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22752): Process ended prematurely: osmo-stp_10.42.42.5(pid=22752) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22752)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22766): Process ended prematurely: osmo-stp_10.42.42.5(pid=22766) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22766)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22777): Process ended prematurely: osmo-stp_10.42.42.5(pid=22777) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22777)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22791): Process ended prematurely: osmo-stp_10.42.42.5(pid=22791) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22791)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22802): Process ended prematurely: osmo-stp_10.42.42.5(pid=22802) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22802)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22816): Process ended prematurely: osmo-stp_10.42.42.5(pid=22816) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22816)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22827): Process ended prematurely: osmo-stp_10.42.42.5(pid=22827) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22827)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22841): Process ended prematurely: osmo-stp_10.42.42.5(pid=22841) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22841)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22852): Process ended prematurely: osmo-stp_10.42.42.5(pid=22852) [trial-2361↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22852)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22867): Process ended prematurely: osmo-stp_10.42.42.5(pid=22867) [trial-2361↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22867)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=22878): Process ended prematurely: osmo-stp_10.42.42.5(pid=22878) [trial-2361↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22878)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22897): Process ended prematurely: osmo-stp_10.42.42.5(pid=22897) [trial-2361↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22897)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=22910): Process ended prematurely: osmo-stp_10.42.42.5(pid=22910) [trial-2361↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22910)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=22928): Process ended prematurely: osmo-stp_10.42.42.5(pid=22928) [trial-2361↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22928)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22938): Process ended prematurely: osmo-stp_10.42.42.5(pid=22938) [trial-2361↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22938)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22948): Process ended prematurely: osmo-stp_10.42.42.5(pid=22948) [trial-2361↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22948)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=22965): Process ended prematurely: osmo-stp_10.42.42.5(pid=22965) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22965)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=22977): Process ended prematurely: osmo-stp_10.42.42.5(pid=22977) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22977)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=22995): Process ended prematurely: osmo-stp_10.42.42.5(pid=22995) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22995)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23005): Process ended prematurely: osmo-stp_10.42.42.5(pid=23005) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23005)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23018): Process ended prematurely: osmo-stp_10.42.42.5(pid=23018) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23018)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23036): Process ended prematurely: osmo-stp_10.42.42.5(pid=23036) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23036)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23048): Process ended prematurely: osmo-stp_10.42.42.5(pid=23048) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23048)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=23066): Process ended prematurely: osmo-stp_10.42.42.5(pid=23066) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23066)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23076): Process ended prematurely: osmo-stp_10.42.42.5(pid=23076) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23076)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23086): Process ended prematurely: osmo-stp_10.42.42.5(pid=23086) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23086)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=23103): Process ended prematurely: osmo-stp_10.42.42.5(pid=23103) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23103)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23115): Process ended prematurely: osmo-stp_10.42.42.5(pid=23115) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23115)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=23133): Process ended prematurely: osmo-stp_10.42.42.5(pid=23133) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23133)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23143): Process ended prematurely: osmo-stp_10.42.42.5(pid=23143) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23143)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23153): Process ended prematurely: osmo-stp_10.42.42.5(pid=23153) [trial-2361↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23153)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23169): Process ended prematurely: osmo-stp_10.42.42.5(pid=23169) [trial-2361↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23169)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23182): Process ended prematurely: osmo-stp_10.42.42.5(pid=23182) [trial-2361↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23182)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=23191): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23191) [trial-2361↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23191)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23201): Process ended prematurely: osmo-stp_10.42.42.5(pid=23201) [trial-2361↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23201)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=23210): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23210) [trial-2361↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23210)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=23262): Process ended prematurely: osmo-stp_10.42.42.5(pid=23262) [trial-2361↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23262)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=23506): Process ended prematurely: osmo-stp_10.42.42.5(pid=23506) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23506)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23517): Process ended prematurely: osmo-stp_10.42.42.5(pid=23517) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23517)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23532): Process ended prematurely: osmo-stp_10.42.42.5(pid=23532) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23532)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23543): Process ended prematurely: osmo-stp_10.42.42.5(pid=23543) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23543)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23557): Process ended prematurely: osmo-stp_10.42.42.5(pid=23557) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23557)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23568): Process ended prematurely: osmo-stp_10.42.42.5(pid=23568) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23568)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23582): Process ended prematurely: osmo-stp_10.42.42.5(pid=23582) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23582)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23593): Process ended prematurely: osmo-stp_10.42.42.5(pid=23593) [trial-2361↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23593)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23607): Process ended prematurely: osmo-stp_10.42.42.5(pid=23607) [trial-2361↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23607)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23618): Process ended prematurely: osmo-stp_10.42.42.5(pid=23618) [trial-2361↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23618)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23632): Process ended prematurely: osmo-stp_10.42.42.5(pid=23632) [trial-2361↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23632)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23646): Process ended prematurely: osmo-stp_10.42.42.5(pid=23646) [trial-2361↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23646)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=23665): Process ended prematurely: osmo-stp_10.42.42.5(pid=23665) [trial-2361↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23665)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23677): Process ended prematurely: osmo-stp_10.42.42.5(pid=23677) [trial-2361↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23677)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=23695): Process ended prematurely: osmo-stp_10.42.42.5(pid=23695) [trial-2361↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23695)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23705): Process ended prematurely: osmo-stp_10.42.42.5(pid=23705) [trial-2361↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23705)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23715): Process ended prematurely: osmo-stp_10.42.42.5(pid=23715) [trial-2361↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23715)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=23732): Process ended prematurely: osmo-stp_10.42.42.5(pid=23732) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23732)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23744): Process ended prematurely: osmo-stp_10.42.42.5(pid=23744) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23744)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=23762): Process ended prematurely: osmo-stp_10.42.42.5(pid=23762) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23762)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23777): Process ended prematurely: osmo-stp_10.42.42.5(pid=23777) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23777)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=23787): Process ended prematurely: osmo-stp_10.42.42.5(pid=23787) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23787)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=23804): Process ended prematurely: osmo-stp_10.42.42.5(pid=23804) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23804)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23816): Process ended prematurely: osmo-stp_10.42.42.5(pid=23816) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23816)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=23834): Process ended prematurely: osmo-stp_10.42.42.5(pid=23834) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23834)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23844): Process ended prematurely: osmo-stp_10.42.42.5(pid=23844) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23844)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23854): Process ended prematurely: osmo-stp_10.42.42.5(pid=23854) [trial-2361↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23854)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23867): Process ended prematurely: osmo-stp_10.42.42.5(pid=23867) [trial-2361↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23867)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23880): Process ended prematurely: osmo-stp_10.42.42.5(pid=23880) [trial-2361↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23880)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=23890): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23890) [trial-2361↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23890)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23901): Process ended prematurely: osmo-stp_10.42.42.5(pid=23901) [trial-2361↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23901)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23916): Process ended prematurely: osmo-stp_10.42.42.5(pid=23916) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23916)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23927): Process ended prematurely: osmo-stp_10.42.42.5(pid=23927) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23927)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23942): Process ended prematurely: osmo-stp_10.42.42.5(pid=23942) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23942)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23953): Process ended prematurely: osmo-stp_10.42.42.5(pid=23953) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23953)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23967): Process ended prematurely: osmo-stp_10.42.42.5(pid=23967) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23967)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23978): Process ended prematurely: osmo-stp_10.42.42.5(pid=23978) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23978)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23995): Process ended prematurely: osmo-stp_10.42.42.5(pid=23995) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23995)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24006): Process ended prematurely: osmo-stp_10.42.42.5(pid=24006) [trial-2361↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24006)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24020): Process ended prematurely: osmo-stp_10.42.42.5(pid=24020) [trial-2361↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24020)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24031): Process ended prematurely: osmo-stp_10.42.42.5(pid=24031) [trial-2361↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24031)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24046): Process ended prematurely: osmo-stp_10.42.42.5(pid=24046) [trial-2361↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24046)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24057): Process ended prematurely: osmo-stp_10.42.42.5(pid=24057) [trial-2361↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24057)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24072): Process ended prematurely: osmo-stp_10.42.42.5(pid=24072) [trial-2361↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24072)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24083): Process ended prematurely: osmo-stp_10.42.42.5(pid=24083) [trial-2361↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24083)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=24101): Process ended prematurely: osmo-stp_10.42.42.5(pid=24101) [trial-2361↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24101)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=24113): Process ended prematurely: osmo-stp_10.42.42.5(pid=24113) [trial-2361↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24113)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=24131): Process ended prematurely: osmo-stp_10.42.42.5(pid=24131) [trial-2361↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24131)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24141): Process ended prematurely: osmo-stp_10.42.42.5(pid=24141) [trial-2361↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24141)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24151): Process ended prematurely: osmo-stp_10.42.42.5(pid=24151) [trial-2361↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24151)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=24171): Process ended prematurely: osmo-stp_10.42.42.5(pid=24171) [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24171)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=24183): Process ended prematurely: osmo-stp_10.42.42.5(pid=24183) [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24183)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=24201): Process ended prematurely: osmo-stp_10.42.42.5(pid=24201) [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24201)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24211): Process ended prematurely: osmo-stp_10.42.42.5(pid=24211) [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24211)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24221): Process ended prematurely: osmo-stp_10.42.42.5(pid=24221) [trial-2361↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24221)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=24238): Process ended prematurely: osmo-stp_10.42.42.5(pid=24238) [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24238)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24250): Process ended prematurely: osmo-stp_10.42.42.5(pid=24250) [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24250)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=24268): Process ended prematurely: osmo-stp_10.42.42.5(pid=24268) [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24268)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24280): Process ended prematurely: osmo-stp_10.42.42.5(pid=24280) [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24280)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24290): Process ended prematurely: osmo-stp_10.42.42.5(pid=24290) [trial-2361↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24290)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=24308): Process ended prematurely: osmo-stp_10.42.42.5(pid=24308) [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24308)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=24320): Process ended prematurely: osmo-stp_10.42.42.5(pid=24320) [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24320)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=24341): Process ended prematurely: osmo-stp_10.42.42.5(pid=24341) [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24341)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24351): Process ended prematurely: osmo-stp_10.42.42.5(pid=24351) [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24351)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24361): Process ended prematurely: osmo-stp_10.42.42.5(pid=24361) [trial-2361↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24361)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24374): Process ended prematurely: osmo-stp_10.42.42.5(pid=24374) [trial-2361↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24374)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=24382): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24382) [trial-2361↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24382)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=24384): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24384) [trial-2361↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24384)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=24386): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24386) [trial-2361↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24386)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=24393): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24393) [trial-2361↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24393)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.7 sec) Error: osmo-hlr_10.42.42.2(pid=24402): Process ended prematurely: osmo-hlr_10.42.42.2(pid=24402) [trial-2361↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24402)] FAIL: esme_connect_policy_closed.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=24413): Process ended prematurely: osmo-hlr_10.42.42.2(pid=24413) [trial-2361↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24413)] FAIL: esme_ms_sms_storeforward.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24425): Process ended prematurely: osmo-stp_10.42.42.5(pid=24425) [trial-2361↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24425)] FAIL: esme_ms_sms_transaction.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24436): Process ended prematurely: osmo-stp_10.42.42.5(pid=24436) [trial-2361↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24436)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24450): Process ended prematurely: osmo-stp_10.42.42.5(pid=24450) [trial-2361↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24450)] FAIL: register_a5_0_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24461): Process ended prematurely: osmo-stp_10.42.42.5(pid=24461) [trial-2361↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24461)] FAIL: register_a5_1_authreq.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24472): Process ended prematurely: osmo-stp_10.42.42.5(pid=24472) [trial-2361↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24472)] FAIL: register_a5_3_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24483): Process ended prematurely: osmo-stp_10.42.42.5(pid=24483) [trial-2361↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24483)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.9 sec) Error: srsepc(pid=24503): Process ended prematurely: srsepc(pid=24503) [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24503)] FAIL: iperf3_bidir.py (18.6 sec) Error: srsepc(pid=24520): Process ended prematurely: srsepc(pid=24520) [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24520)] FAIL: iperf3_dl.py (18.5 sec) Error: srsepc(pid=24536): Process ended prematurely: srsepc(pid=24536) [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24536)] FAIL: iperf3_ul.py (20.0 sec) Error: srsepc(pid=24823): Process ended prematurely: srsepc(pid=24823) [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24823)] FAIL: ping.py (18.1 sec) Error: srsepc(pid=24841): Process ended prematurely: srsepc(pid=24841) [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24841)] FAIL: rrc_idle_mo_ping.py (18.6 sec) Error: srsepc(pid=24858): Process ended prematurely: srsepc(pid=24858) [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24858)] FAIL: rrc_idle_mt_ping.py (18.3 sec) Error: srsepc(pid=24875): Process ended prematurely: srsepc(pid=24875) [trial-2361↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24875)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24888): Process ended prematurely: osmo-stp_10.42.42.5(pid=24888) [trial-2361↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24888)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24903): Process ended prematurely: osmo-stp_10.42.42.5(pid=24903) [trial-2361↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24903)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24918): Process ended prematurely: osmo-stp_10.42.42.5(pid=24918) [trial-2361↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24918)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24935): Process ended prematurely: osmo-stp_10.42.42.5(pid=24935) [trial-2361↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24935)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24949): Process ended prematurely: osmo-stp_10.42.42.5(pid=24949) [trial-2361↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24949)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24963): Process ended prematurely: osmo-stp_10.42.42.5(pid=24963) [trial-2361↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24963)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24977): Process ended prematurely: osmo-stp_10.42.42.5(pid=24977) [trial-2361↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24977)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24991): Process ended prematurely: osmo-stp_10.42.42.5(pid=24991) [trial-2361↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24991)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25006): Process ended prematurely: osmo-stp_10.42.42.5(pid=25006) [trial-2361↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25006)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25021): Process ended prematurely: osmo-stp_10.42.42.5(pid=25021) [trial-2361↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25021)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25035): Process ended prematurely: osmo-stp_10.42.42.5(pid=25035) [trial-2361↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25035)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25049): Process ended prematurely: osmo-stp_10.42.42.5(pid=25049) [trial-2361↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25049)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25063): Process ended prematurely: osmo-stp_10.42.42.5(pid=25063) [trial-2361↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25063)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25077): Process ended prematurely: osmo-stp_10.42.42.5(pid=25077) [trial-2361↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25077)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25091): Process ended prematurely: osmo-stp_10.42.42.5(pid=25091) [trial-2361↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25091)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25105): Process ended prematurely: osmo-stp_10.42.42.5(pid=25105) [trial-2361↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25105)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25119): Process ended prematurely: osmo-stp_10.42.42.5(pid=25119) [trial-2361↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25119)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=25136): Process ended prematurely: osmo-stp_10.42.42.5(pid=25136) [trial-2361↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25136)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25150): Process ended prematurely: osmo-stp_10.42.42.5(pid=25150) [trial-2361↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25150)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25164): Process ended prematurely: osmo-stp_10.42.42.5(pid=25164) [trial-2361↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25164)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25178): Process ended prematurely: osmo-stp_10.42.42.5(pid=25178) [trial-2361↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25178)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25193): Process ended prematurely: osmo-stp_10.42.42.5(pid=25193) [trial-2361↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25193)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25207): Process ended prematurely: osmo-stp_10.42.42.5(pid=25207) [trial-2361↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25207)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25221): Process ended prematurely: osmo-stp_10.42.42.5(pid=25221) [trial-2361↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25221)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25235): Process ended prematurely: osmo-stp_10.42.42.5(pid=25235) [trial-2361↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25235)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25249): Process ended prematurely: osmo-stp_10.42.42.5(pid=25249) [trial-2361↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25249)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=25265): Process ended prematurely: osmo-stp_10.42.42.5(pid=25265) [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25265)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25279): Process ended prematurely: osmo-stp_10.42.42.5(pid=25279) [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25279)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25294): Process ended prematurely: osmo-stp_10.42.42.5(pid=25294) [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25294)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25311): Process ended prematurely: osmo-stp_10.42.42.5(pid=25311) [trial-2361↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25311)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25326): Process ended prematurely: osmo-stp_10.42.42.5(pid=25326) [trial-2361↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25326)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25340): Process ended prematurely: osmo-stp_10.42.42.5(pid=25340) [trial-2361↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25340)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25354): Process ended prematurely: osmo-stp_10.42.42.5(pid=25354) [trial-2361↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25354)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25368): Process ended prematurely: osmo-stp_10.42.42.5(pid=25368) [trial-2361↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25368)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=25382): Process ended prematurely: osmo-stp_10.42.42.5(pid=25382) [trial-2361↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25382)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25396): Process ended prematurely: osmo-stp_10.42.42.5(pid=25396) [trial-2361↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25396)] + rm -rf trial-2361/inst + cd trial-2361 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-09 15:36:47 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361-run.tgz run.2022-12-09_15-36-58 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17653.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6678.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2948.tgz osmo-mgw.build-8943.tgz osmo-msc.build-29260.tgz osmo-nitb.build-12965.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30036.tgz osmo-stp.build-9238.tgz osmo-trx.build-4675.tgz osmocom-bb.build-4699.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE